ML Engineer – LLM API Unifier & Infra Innovator

FDE Times

San Francisco (CA)

Vor Ort

USD 120.000 - 180.000

Vollzeit

Vor 9 Tagen

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Benefits dieser Stelle

Competitive salary
Equity
Health benefits
Dental benefits
Vision benefits

Zusammenfassung

LiteLLM, a leading AI gateway, is seeking an ML Engineer to unify API calls across OpenAI/Anthropic specs and transform requests for multiple LLM providers. You’ll work with the CEO and CTO on critical projects, including system design and developer experience enhancements.

You’ll contribute to a Python-based stack (FastAPI, Redis, Postgres) and help ship features used by thousands of engineering teams worldwide, in a fast-paced startup environment.

Qualifikationen

  • 1-2 years of backend/full-stack experience with production systems.
  • Passion for open source and user engagement.
  • Experience working with the OpenAI API (difference between /chat/completions and /responses).
  • Strong work ethic and ability to thrive in small teams.
  • Eagerness to talk to users and solve real problems.

Aufgaben

  • System design for provider-level features at the gateway layer (skills, compaction, batches).
  • Enhance developer experience to support millions of users via LiteLLM's Python SDK.
  • Build across LLMs, MCPs, and Agents with an interoperability layer and various Agent use-cases.

Kenntnisse

Python
LLM APIs
FastAPI

Tools

Redis
Postgres

Jobbeschreibung

LiteLLM, a leading AI gateway, is seeking an ML Engineer to unify API calls across OpenAI/Anthropic specs and transform requests for multiple LLM providers. You’ll work with the CEO and CTO on critical projects, including system design and developer experience enhancements.

You’ll contribute to a Python-based stack (FastAPI, Redis, Postgres) and help ship features used by thousands of engineering teams worldwide, in a fast-paced startup environment.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

ML Engineer: LLM Interop & AI Gateway (Equity)
ML Engineer: LLM Interop & AI Gateway (Equity)

LiteLLM • San Francisco (CA)

Vor Ort
USD 120.000 - 180.000
Competitive salary
Equity and benefits (health, dental, &
Vision benefits
ML Engineer
ML Engineer

FDE Times • San Francisco (CA)

Vor Ort
USD 120.000 - 180.000
Competitive salary
Equity
Health benefits
+2
ML Engineer
ML Engineer

LiteLLM • San Francisco (CA)

Vor Ort
USD 120.000 - 180.000
Competitive salary
Equity and benefits (health, dental, &
Vision benefits
AI Engineer
AI Engineer

FDE Times • San Francisco (CA)

Vor Ort
USD 110.000 - 170.000
Equity
Health insurance
Dental coverage
+1
Staff AI Engineer — Unified LLM API Lead (SF)
Staff AI Engineer — Unified LLM API Lead (SF)

Abundant Code • San Francisco (CA)

Vor Ort
USD 250.000 - 350.000
Relocation assistance
Visa sponsorship may be available
Equity, health, dental, and vision
Staff Engineer, AI
Staff Engineer, AI

LiteLLM • San Francisco (CA)

Vor Ort
USD 180.000 - 260.000
Founders collaboration
Open source contributions
Comprehensive benefits
Staff Engineer, AI
Staff Engineer, AI

AItoolnavio • San Francisco (CA)

Vor Ort
USD 210.000 - 320.000
Relocation assistance
H-1B transfer support
Equity
+3
Staff Engineer, AI
Staff Engineer, AI

FDE Times • San Francisco (CA)

Vor Ort
USD 180.000 - 250.000
Competitive salary
Equity
Health benefits
+2
AI Gateway Engineer — Impactful Backend, Equity
AI Gateway Engineer — Impactful Backend, Equity

FDE Times • San Francisco (CA)

Vor Ort
USD 110.000 - 170.000
Equity
Health insurance
Dental coverage
+1
Staff Engineer, AI LiteLLM
Staff Engineer, AI LiteLLM

Abundant Code • San Francisco (CA)

Vor Ort
USD 250.000 - 350.000
Relocation assistance
Visa sponsorship may be available
Equity, health, dental, and vision