Product Engineer

LiteLLM; San Francisco (CA); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Salary acknowledged equity

Health, dental, and vision benefits

Direct exposure to founders

Fast-paced, production-ready impact

Job summary

LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.

If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.

Qualifications

• Bachelor's or Master's degree in Computer Science or a related field.
• Strong software engineering fundamentals.
• Experience building production software, preferably with Python.
• Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
• Strong product intuition and curiosity about how customers use software.
• Excellent written and verbal communication.
• High ownership—you naturally identify problems and solve them without waiting to be asked.
• Comfortable operating in ambiguity and making decisions with incomplete information.
• Excited by shipping quickly and learning from real users.

Responsibilities

• Talk to customers, understand problems, and design solutions.
• Write production code and ship features.
• Ship end-to-end features from idea to production.
• Work across the stack (backend, frontend, infrastructure, APIs) as needed.
• Own problems end-to-end and move proposals forward without delay.

Skills

Strong fundamentals

Communication

Product intuition

Ownership

Ambiguity tolerance

Education

Bachelor's or Master's in Computer Science

Tools

Python

APIs

Frontend

Backend

Infra concepts

Job description

Product Engineer

LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.

We're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.

About the Role

This isn't a traditional product management role, and it isn't a traditional software engineering role.

You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.

If you enjoy owning a problem end-to-end—from idea to production—you'll thrive here.

What We're Looking For

• Bachelor's or Master's degree in Computer Science or a related field.

• Strong software engineering fundamentals.

• Experience building production software, preferably with Python.

• Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).

• Strong product intuition and curiosity about how customers use software.

• Excellent written and verbal communication.

• High ownership—you naturally identify problems and solve them without waiting to be asked.

• Comfortable operating in ambiguity and making decisions with incomplete information.

• Excited by shipping quickly and learning from real users.

Bonus Points

• Experience at an early-stage startup.

• Experience building developer tools or infrastructure products.

• Open source contributions.

• You've built and launched your own product.

• Familiarity with AI infrastructure, LLMs, or developer platforms.

Why Join LiteLLM?

• Work directly with the founders every day.

• Build products used by thousands of engineering teams around the world.

• Own meaningful product decisions—not just implementation.

• Move incredibly fast and see your work in production immediately.

• Help define the future of AI infrastructure and developer tooling.

• Competitive salary, equity, health, dental, and vision benefits.

About LiteLLM

LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.

If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.