Senior Backend Software Engineer (Workload Safety)

Affirm, Inc.

Ottawa

Remote

CAD 140,000 - 180,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Remote-first compensation
Remote-first Workforce
Health Benefits
Parental Leave
Away Days
Learning & Development
Generous Time Off
Mental Healthcare

Job summary

Affirm, Inc. seeks a senior engineer to define and evolve workload safety standards for its EKS fleet, ensuring compliant, scalable operations across the fleet. You will drive policy-driven automation, mentor engineers, and lead cross-team initiatives from design through rollout.

You will isolate workloads, handle terminations gracefully, and shape capacity planning for bursty workloads, while aligning with availability and latency objectives.

Qualifications

  • 5+ years of experience running Kubernetes in production at scale.
  • Deep understanding of Kubernetes resource management and scheduling.
  • Experience enforcing configuration standards through admission control and policy-as-code.
  • Strong written communication and cross-team collaboration.
  • Track record leading technical initiatives across multiple teams.
  • Experience running Amazon EKS across many clusters.
  • Proficiency in Go or Python for production infrastructure.

Responsibilities

  • Define and evolve workload safety standards for affirm’s EKS fleet.
  • Own standards end to end from research to enforcement across the fleet.
  • Lead cross-team initiatives and mentor other engineers.
  • Isolate workloads by criticality and resource profile to protect critical paths.
  • Develop control plane scaling patterns for bursty workloads.
  • Automate analysis of resource profiles and instance strategies.

Skills

Go
Python
Kubernetes
Admission controllers
Policy as code
OPA Gatekeeper
Kyverno
Karpenter

Tools

Kubernetes controllers
Operators
Admission webhooks

Job description

  • Affirm runs its workloads on more than 85 Amazon EKS clusters, and the number is growing. The Workload Safety team creates one set of standards for how workloads are configured and run, so affirm can grow globally and still meet its availability and latency SLOs
  • The team identifies the industry best practices affirm needs, drives their adoption across every engineering team on EKS, and enforces them through policy and automation so new workloads comply by default
  • As a senior engineer on the team, you will help set its roadmap, decide which standards matter most, and build a repeatable way to take each standard from research to enforcement across the fleet
  • Define and evolve workload safety standards for affirm’s EKS fleet, such as CPU and memory settings, workload isolation and placement, tolerance for disruption, graceful termination to name a few
  • Own each standard end to end: research and prototyping, white-glove onboarding for early adopters, self-service guidance for everyone else, and automation and policy guardrails that keep every workload compliant from day one
  • Lead cross-team initiatives from design through fleet-wide rollout, mentor other engineers, and set a high bar for design, code review, and operational readiness
  • Isolate workloads by criticality and resource profile so one misbehaving workload cannot degrade critical paths such as checkout
  • Fix stuck workloads and node lifecycle problems, such as pods that ignore termination signals, pod disruption budgets that block node cycling, and Karpenter timeouts that prevent bin packing and the removal of excess capacity
  • Determine the safe operating limits of each cluster (pod count, node count, API server request volume), keep clusters within them, and develop control plane scaling patterns for bursty workloads such as scheduled batch jobs and large deployments
  • Analyze workload resource profiles across the fleet (CPU, memory, disk, network) to guide EC2 instance type strategy, and automate that analysis as workloads change
  • Measure each standard’s impact on availability, latency, risk, and cost, and use the results to prioritize the roadmap
  • Participate in on-call for Kubernetes runtime issues across the fleet, and turn recurring failure patterns into roadmap items
  • Work closely with the teams that run services, batch jobs, and ML workloads on EKS, and with the deployment, capacity, and SRE teams
  • Keep up with new best practices from the Kubernetes community and adapt them to affirm’s needs
Benefits
  • Compensation: We have a simple, flexible, and transparent remote-first compensation structure so you can make the best decisions for yourself and your family
  • Spending Wallets: Access tech, food, lifestyle, and family planning wallets for your expenses
  • Supportive Communities: Get involved with our employee resource groups and community groups
  • Remote-first Workforce: If your role is remote, you can set up shop anywhere in your home country
  • Generous Time Off: Take the time you need when life happens
  • Health Benefits: Get a plan that fits your needs
  • Mental Healthcare: Take care of your mind with great mental health programs
  • Parental Leave: Birth and non-birth parents get 18 weeks’ paid leave. Plus, a 4-week return-to-work transition program, at full base pay
  • Away Days: We offer 20 company-wide paid days off—which help our teams collectively pause to recharge
  • Learning & Development: Engage in exciting learning programs to level up your growth

Proficiency in Go or Python, including building production infrastructure software such as Kubernetes controllers, operators, or admission webhooks Deep understanding of Kubernetes resource management and scheduling: requests and limits, OOM and CPU throttling behavior, affinity and anti-affinity, taints and tolerations, and topology spread constraints Experience enforcing configuration standards through admission control and policy-as-code (for example, OPA Gatekeeper or Kyverno) Strong written communication, including standards and guidance that teams can adopt on their own 5+ years of experience running Kubernetes in production at scale, ideally Amazon EKS across many clusters Experience quantifying the impact of infrastructure changes on availability, latency, and cost Solid grasp of the pod lifecycle and disruption management, including graceful termination, pod disruption budgets, and node draining Track record of leading technical initiatives across multiple teams, driving adoption of shared standards, and mentoring other engineers Strong production debugging skills and a demonstrated ability to turn recurring incidents into systemic fixes

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Staff Backend Engineer (Compute Platform)
Senior Staff Backend Engineer (Compute Platform)

Affirm, Inc. • Ottawa

Remote
CAD 120,000 - 160,000
Remote-first compensation
Learning & Development
Health Benefits
+5
Senior Staff Engineer - Kubernetes & AWS Platform NEW
Senior Staff Engineer - Kubernetes & AWS Platform NEW

The Briefed • Canada

Remote
CAD 180,000 - 240,000
Base pay + equity
Employee Stock Purchase Plan (ESPP)
100% subsidized health coverage
+2
Senior Backend Software Engineer (Trust & Safety)
Senior Backend Software Engineer (Trust & Safety)

Affirm, Inc. • Ottawa

Remote
CAD 120,000 - 180,000
Remote-first compensation
Spending Wallets
Health Benefits
+3
Senior Staff Software Engineer, Backend (Compute Platform)
Senior Staff Software Engineer, Backend (Compute Platform)

Affirm, Inc. • Ottawa

Remote
CAD 209,000 - 269,000
Health coverage for you and dependents
Monthly tech stipend
Generous time off and holidays
+1
Senior Staff Software Engineer, Backend (Compute Platform)
Senior Staff Software Engineer, Backend (Compute Platform)

Affirm, Inc. • Edmonton

Remote
CAD 292,000 - 376,000
Health coverage for you and dependents
Monthly tech stipends
Flexible time off
+1
Staff Fullstack Software Engineer (Account Management)
Staff Fullstack Software Engineer (Account Management)

Affirm, Inc. • Ottawa

Remote
CAD 120,000 - 170,000
Remote-first compensation structure
Spending Wallets
Health benefits
Senior Staff Software Engineer, Backend (Compute Platform)
Senior Staff Software Engineer, Backend (Compute Platform)

Affirm, Inc. • Halifax

Remote
CAD 209,000 - 269,000
Health coverage
Tech stipends
ESPP
Senior Staff Software Engineer, Backend (Compute Platform)
Senior Staff Software Engineer, Backend (Compute Platform)

Affirm, Inc. • Calgary

Remote
CAD 209,000 - 269,000
Health coverage for you and dependents
Tech stipend for setup and tools
Flexible time off and holidays
Senior Staff Software Engineer, Backend (Compute Platform)
Senior Staff Software Engineer, Backend (Compute Platform)

Affirm, Inc. • Canada

Remote
CAD 292,000 - 376,000
100% premium coverage for employees &
Monthly tech stipends
Flexible time off
+1
Senior Staff Software Engineer, Backend (Compute Platform)
Senior Staff Software Engineer, Backend (Compute Platform)

Affirm, Inc. • Regina

Remote
CAD 209,000 - 269,000
Health coverage for you and dependents
Tech setup stipends
Flexible time off
+1