Staff Engineer, Reliability & Stability for AI Gateway

LiteLLM; San Francisco (CA); On-site; USD 180,000 - 260,000; Full time

Benefits offered by this job

Relocation assistance

Competitive compensation

Health, dental, and vision benefits

Direct collaboration with founders

Job summary

LiteLLM is seeking a Staff Engineer to own the stability and reliability of the AI gateway used by thousands of companies. This hands-on role focuses on root-cause analysis, refactors, and bold rewrites to prevent regressions and security issues, with immediate production impact.

You will work closely with security and infrastructure teams, report to the CEO (then Head of Engineering), and contribute to a fast-moving, in-person SF environment. relocation support available.

Qualifications

• 3+ years of experience and growing scope at a strong engineering company.
• Owned stability or reliability in production environments.
• Led rewrites or migrations to improve code quality.
• Walk into unfamiliar codebases and find root causes.

Responsibilities

• Find root causes of regressions and security issues and fix patterns.
• Lead refactors, rewrites, and migrations of core product code.
• Decide what makes our test suite trustworthy and build it.
• Keep CI and releases fast and trustworthy with a large open source contributor base.
• Review critical code paths and raise quality through code and reviews.
• Raise quality across the team without becoming the bottleneck.

Skills

Experience 3+ years

Stability & reliability

Root cause analysis

First principles thinking

Customer empathy

Python engineering

Open source/CI experience

Tools

CI/CD pipelines

Open source contributions

Job description

LiteLLM is seeking a Staff Engineer to own the stability and reliability of the AI gateway used by thousands of companies. This hands-on role focuses on root-cause analysis, refactors, and bold rewrites to prevent regressions and security issues, with immediate production impact.

You will work closely with security and infrastructure teams, report to the CEO (then Head of Engineering), and contribute to a fast-moving, in-person SF environment. relocation support available.