Agile Java Man

Musings on Data Science, Software Architecture, Functional Programming and whatnot.

Monday, November 24, 2025

AWS and HTTPs

›
This proved surprisingly hard but the take-away points are: A Kubernetes service account must be given permissioned to access AWS infra stru...
Tuesday, November 18, 2025

Snowflake and AWS

›
This is how you get Snowflake to talk to your AWS real estate. Before we start, get your AWS account ID with: aws sts get-caller-identity  T...
Saturday, November 15, 2025

Debugging Google Cloud Kubernetes

›
A problem I was having when spinning up a K8s cluster and then trying to deploy my own Polaris was that the pod stuck in the  Pending stat...
Wednesday, November 5, 2025

Spark Operator

›
I've found that managing Spark clusters in Kubernetes is far easier using the Spark Operator. Here are some commands that helped me diag...
Monday, November 3, 2025

AWS, Kubernetes and more

›
Setting up a 3 node Kubernetes cluster in AWS is as simple as: eksctl create cluster --name $CLUSTERNAME --nodes 3 but this really hides a h...
Thursday, October 23, 2025

Exactly Once Semantics in Iceberg/Kafka

›
Iceberg has a Kafka Connect component that ensures exactly one semantics despite there being two transactions for the two systems (Kafka and...
Monday, October 20, 2025

Spark and K8s on AWS

›
This is a high-level overview of my work creating a Spark cluster running in a managed AWS Kubernetes cluster (EKS) giving Spark the permiss...
›
Home
View web version

About Me

Phillip Henry
https://www.linkedin.com/in/phillhenry/
View my complete profile
Powered by Blogger.