Resilience Engineering Manager – Production Testing

Affirm, Inc.; Los Angeles (CA); Remote; USD 230,000 - 290,000; Full time

Benefits offered by this job

Health coverage for you and dependents

Monthly tech stipends

Flexible time off and holidays

Employee stock purchase plan

Job summary

Affim is seeking a seasoned Engineering Manager to lead the Resilience Engineering team, driving production load testing and chaos experiments to safeguard live systems.

You will mentor engineers, define the resilience strategy, and partner with infrastructure, product, and security to weave validation into the software lifecycle. A strong programming background and cloud-native experience are valued in this remote-first role.

Qualifications

• Proven experience leading engineering teams in reliability, infrastructure, or distributed systems.
• Hands-on experience with production load testing, chaos engineering, or large-scale system validation.
• Experience with leveraging a chaos engineering vendor such as Gremlin, Harness, or something similar.
• Strong understanding of failure modes in distributed systems, including latency, partial failure, and cascading outages.
• Experience building or operating systems with strong safety guarantees (isolation, rate limiting, guardrails, auditability).
• Familiarity with cloud-native environments (AWS, Kubernetes) and observability tooling.
• Strong programming background (e.g., Python, Kotlin, Java, or similar).
• Excellent problem-solving skills and the ability to balance long-term resilience investments with immediate business needs.
• Strong communication and leadership skills, with a track record of influencing engineering practices across teams.
• This position requires either equivalent practical experience or a Bachelor’s degree in a related field.

Responsibilities

• Define and drive the vision for resilience engineering at Affim, focusing on production load testing and chaos engineering as core practices.
• Lead and mentor engineers building platforms and tooling for safe production experimentation.
• Partner with infrastructure, product, and security leadership to embed resilience validation into the SDLC.
• Establish best practices for safely testing system limits and failure scenarios in production.
• Own the design and evolution of platforms enabling safe production load testing and fault injection.
• Ensure safeguards, isolation, approvals, and automated rollback protect real users.
• Provide reusable tooling, frameworks, and standardized workflows to enable resilience testing across teams.
• Identify systemic weaknesses and drive cross-functional reliability improvements.

Skills

Leadership

Reliability engineering

Production load testing

Chaos engineering

Distributed systems

Cloud-native (AWS/Kubernetes)

Programming (Python/Java/Kotlin)

Communication

Education

Bachelor’s degree or equivalent

Tools

Gremlin

Harness

Observability tooling

Kubernetes

Job description

Affim is seeking a seasoned Engineering Manager to lead the Resilience Engineering team, driving production load testing and chaos experiments to safeguard live systems.

You will mentor engineers, define the resilience strategy, and partner with infrastructure, product, and security to weave validation into the software lifecycle. A strong programming background and cloud-native experience are valued in this remote-first role.