Staff AI Engineer: Unified API Gateway Lead

present of AI; San Francisco (CA); On-site; USD 160,000 - 230,000; Full time

Job summary

LiteLLM in San Francisco is seeking a hands-on Senior Lead to own provider integrations and gateway rollouts from start to finish. You will review code, handle open source issues, and mentor engineers while still writing production Python.

Expect to maintain a unified API across multiple providers and navigate API differences with deep technical judgment. This role sits at the crossroads of fast-moving model providers and real applications.

Qualifications

• Solid Python skills.
• Ability to lead engineers while coding.
• Experience reviewing code and handling open source issues/PRs.
• Built or maintained a unified API across multiple providers.
• Knowledge of provider API differences in detail.

Responsibilities

• Own new provider and endpoint rollouts end-to-end.
• Review code and manage open source issues and PRs.
• Lead engineers while continuing to write production-grade Python.
• Maintain a unified API interface across many providers and models.

Skills

Python

Leadership

Code review

Open source contributions

Unified API

LLM API expertise

Job description

LiteLLM in San Francisco is seeking a hands-on Senior Lead to own provider integrations and gateway rollouts from start to finish. You will review code, handle open source issues, and mentor engineers while still writing production Python.

Expect to maintain a unified API across multiple providers and navigate API differences with deep technical judgment. This role sits at the crossroads of fast-moving model providers and real applications.