Recebe uma resposta deste empregador
O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.
LiteLLM, a leading AI gateway, is seeking an ML Engineer to unify API calls across OpenAI/Anthropic specs and transform requests for multiple LLM providers. You’ll work with the CEO and CTO on critical projects, including system design and developer experience enhancements.
You’ll contribute to a Python-based stack (FastAPI, Redis, Postgres) and help ship features used by thousands of engineering teams worldwide, in a fast-paced startup environment.
LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.
As the ML Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including:
The tech stack includes Python, FastAPI, Redis, Postgres.
LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.
If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.