Senior Backend Engineer — Kubernetes & Policy Automation

Affirm, Inc.; Philadelphia (Philadelphia County); À distance; USD 173 000 - 255 000; Plein temps

Avantages offerts par ce poste

Health coverage at no cost

Monthly stipends for tech setup

Time off and holidays

Résumé du poste

affirm is seeking a senior engineer to define and scale workload safety standards across its EKS fleet. You will own standards from research to enforcement, building self-service guidance and automation for conformity from day one.

You will lead cross-team efforts, mentor engineers, and help shape design reviews and operational readiness across the fleet. The role emphasizes deep Kubernetes expertise, Go or Python production skills, and experience turning incidents into systemic improvements.

Qualifications

• 5+ years of experience running Kubernetes in production at scale, ideally Amazon EKS across many clusters.
• Deep understanding of Kubernetes resource management and scheduling: requests and limits, OOM and CPU throttling behavior, affinity and anti-affinity, taints and tolerations, and topology spread constraints.
• Solid grasp of the pod lifecycle and disruption management, including graceful termination, pod disruption budgets, and node draining.
• Experience enforcing configuration standards through admission control and policy-as-code (OPA Gatekeeper or Kyverno).
• Proficiency in Go or Python, including building production infrastructure software such as Kubernetes controllers, operators, or admission webhooks.
• Strong production debugging skills and a demonstrated ability to turn recurring incidents into systemic fixes.
• Track record of leading technical initiatives across multiple teams, driving adoption of shared standards, and mentoring other engineers.
• Experience quantifying the impact of infrastructure changes on availability, latency, and cost.
• Strong written communication, including standards and guidance that teams can adopt on their own.
• This position requires either equivalent practical experience or a Bachelor’s degree in a related field.

Responsabilités

• Define and evolve workload safety standards for affirm's EKS fleet, such as CPU and memory settings, workload isolation and placement, tolerance for disruption, graceful termination to name a few
• Own each standard end to end: research and prototyping, white-glove onboarding for early adopters, self-service guidance for everyone else, and automation and policy guardrails that keep every workload compliant from day one
• Lead cross-team initiatives from design through fleet-wide rollout, mentor other engineers, and set a high bar for design, code review, and operational readiness
• Isolate workloads by criticality and resource profile so one misbehaving workload cannot degrade critical paths such as checkout
• Fix stuck workloads and node lifecycle problems, such as pods that ignore termination signals, pod disruption budgets that block node cycling, and Karpenter timeouts that prevent bin packing and the removal of excess capacity
• Determine the safe operating limits of each cluster (pod count, node count, API server request volume), keep clusters within them, and develop control plane scaling patterns for bursty workloads such as scheduled batch jobs and large deployments
• Analyze workload resource profiles across the fleet (CPU, memory, disk, network) to guide EC2 instance type strategy, and automate that analysis as workloads change
• Measure each standard's impact on availability, latency, risk, and cost, and use the results to prioritize the roadmap
• Participate in on-call for Kubernetes runtime issues across the fleet, and turn recurring failure patterns into roadmap items
• Work closely with the teams that run services, batch jobs, and ML workloads on EKS, and with the deployment, capacity, and SRE teams
• Keep up with new best practices from the Kubernetes community and adapt them to affirm's needs

Connaissances

Kubernetes

Go

Python

Production debugging

Shelved: leadership across teams

Formation

Bachelor's degree or equivalent practical experience

Outils

OPA Gatekeeper

Kyverno

Go

Python

Description du poste

affirm is seeking a senior engineer to define and scale workload safety standards across its EKS fleet. You will own standards from research to enforcement, building self-service guidance and automation for conformity from day one.

You will lead cross-team efforts, mentor engineers, and help shape design reviews and operational readiness across the fleet. The role emphasizes deep Kubernetes expertise, Go or Python production skills, and experience turning incidents into systemic improvements.