ML Engineer

present of AI; San Francisco (CA); On-site; USD 150,000 - 190,000; Full time

Job summary

present of AI seeks a backend engineer to build a gateway that speaks the OpenAI-style interface across many model providers. You will implement Python services, leverage FastAPI, and anticipate quirks in provider APIs to deliver a clean, predictable layer for developers.

You will work with users and cross-functional teams to shape what to build next, and contribute to open source conversations related to the gateway and its tooling.

Qualifications

• Proficient Python backend development for production systems.
• Experience with FastAPI and RESTful services.
• Strong familiarity with OpenAI style APIs and provider quirks.

Responsibilities

• Translate differences across AI providers into a unified interface.
• Design a robust gateway layer handling routing, access control, and spend tracking.
• Engage with users to gather needs and iterate on the product roadmap.

Skills

Python

FastAPI

OpenAI API fluency

API design

Job description

The role is about making one gateway speak the same language as many model providers. A strong candidate writes Python services, knows the OpenAI style API well enough to spot its quirks, and can turn provider differences into clean, shared behavior. Comfort with FastAPI and production backend work matters, along with a genuine interest in open source and talking to the people who use the product.

How it fits the AI era

Much of the work is translation between AI providers, which is exactly where AI tools help draft and test request conversions quickly. The human part is judgment about what a unified interface should do, which provider quirks matter to developers, and how to keep behavior predictable across many models. Talking to users and deciding what to build stays with the engineer.

How it builds AI experience

Working here means daily contact with many model APIs, so someone would learn the practical differences between providers and how a shared layer absorbs them. Building that knowledge starts with hands on use of the OpenAI style API and reading how other providers structure requests. The gateway setting gives direct exposure to routing, access control and spend tracking around AI calls.

Worth showing

• Python backend services
• FastAPI experience
• OpenAI API fluency
• Provider API differences
• Open source contributions

This is our own read, written from the employer's posting and the company's Spotlight. The employer's posting is the source of truth for the role.

About LiteLLM

An open-source gateway that, the company says, lets developers call more than 100 AI model providers through one OpenAI-style interface, with spend tracking and access controls.