Staff AI Engineer — Unified LLM API Lead (SF)

Abundant Code; San Francisco (CA); On-site; USD 250,000 - 350,000; Full time

Benefits offered by this job

Relocation assistance

Visa sponsorship may be available

Equity, health, dental, and vision

Job summary

LiteLLM is hiring a Staff Engineer to lead our unified API team in San Francisco. You’ll own how LiteLLM unifies LLM APIs across OpenAI and Anthropic specs, guiding engineers and setting the bar for code quality.

This hands-on role requires leading a team from day one, shipping new model and provider integrations, and ensuring a great developer experience for LiteLLM’s Python SDK and proxy. Relocation support and H-1B transfers available.

Qualifications

• Has built or maintained APIs that sit in front of multiple providers.
• Deep experience with LLM APIs and provider nuances.
• Strong Python development fundamentals.

Responsibilities

• Lead the unified API team and own end-to-end model, endpoint, and provider rollouts.
• Design provider-agnostic features at gateway level (session management for non-OpenAI models).
• Triage open source issues and PRs, merge or implement internal fixes.

Skills

LLM APIs

Unified API design

Python

Developer experience

Customer empathy

Team leadership

Open-source awareness

Tools

FastAPI

Redis

PostgreSQL

Rust

Job description

LiteLLM is hiring a Staff Engineer to lead our unified API team in San Francisco. You’ll own how LiteLLM unifies LLM APIs across OpenAI and Anthropic specs, guiding engineers and setting the bar for code quality.

This hands-on role requires leading a team from day one, shipping new model and provider integrations, and ensuring a great developer experience for LiteLLM’s Python SDK and proxy. Relocation support and H-1B transfers available.