End-to-End Product Engineer

LiteLLM

San Francisco (CA)

On-site

USD 150,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Salary acknowledged equity
Health, dental, and vision benefits
Direct exposure to founders
Fast-paced, production-ready impact

Job summary

LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.

If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.

Qualifications

  • Bachelor's or Master's degree in Computer Science or a related field.
  • Strong software engineering fundamentals.
  • Experience building production software, preferably with Python.
  • Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
  • Strong product intuition and curiosity about how customers use software.
  • Excellent written and verbal communication.
  • High ownership—you naturally identify problems and solve them without waiting to be asked.
  • Comfortable operating in ambiguity and making decisions with incomplete information.
  • Excited by shipping quickly and learning from real users.

Responsibilities

  • Talk to customers, understand problems, and design solutions.
  • Write production code and ship features.
  • Ship end-to-end features from idea to production.
  • Work across the stack (backend, frontend, infrastructure, APIs) as needed.
  • Own problems end-to-end and move proposals forward without delay.

Skills

Strong fundamentals
Communication
Product intuition
Ownership
Ambiguity tolerance

Education

Bachelor's or Master's in Computer Science

Tools

Python
APIs
Frontend
Backend
Infra concepts

Job description

LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.

If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Product Engineer
Product Engineer

LiteLLM • San Francisco (CA)

On-site
USD 150,000 - 210,000
Salary acknowledged equity
Health, dental, and vision benefits
Direct exposure to founders
+1
ML Engineer
ML Engineer

LiteLLM • San Francisco (CA)

On-site
USD 120,000 - 180,000
Competitive salary
Equity and benefits (health, dental, &
Vision benefits
ML Engineer: LLM Interop & AI Gateway (Equity)
ML Engineer: LLM Interop & AI Gateway (Equity)

LiteLLM • San Francisco (CA)

On-site
USD 120,000 - 180,000
Competitive salary
Equity and benefits (health, dental, &
Vision benefits
Forward Deployed Engineer
Forward Deployed Engineer

LiteLLM • United States

On-site
USD 120,000 - 180,000
Competitive salary
Health benefits
Dental and vision benefits
+1
Staff Engineer, AI
Staff Engineer, AI

LiteLLM • San Francisco (CA)

On-site
USD 180,000 - 260,000
Founders collaboration
Open source contributions
Comprehensive benefits
Staff Engineer, AI
Staff Engineer, AI

AItoolnavio • San Francisco (CA)

On-site
USD 210,000 - 320,000
Relocation assistance
H-1B transfer support
Equity
+3
Forward Deployed Engineer (New Grad)
Forward Deployed Engineer (New Grad)

LiteLLM • United States

On-site
USD 80,000 - 110,000
Health benefits
401k with match
Staff Engineer, AI LiteLLM
Staff Engineer, AI LiteLLM

Abundant Code • San Francisco (CA)

On-site
USD 250,000 - 350,000
Relocation assistance
Visa sponsorship may be available
Equity, health, dental, and vision
Staff Engineer, Systems and Reliability
Staff Engineer, Systems and Reliability

LiteLLM • San Francisco (CA)

On-site
USD 180,000 - 260,000
Relocation assistance
Competitive compensation
Health, dental, and vision benefits
+1
Head of Customer Success & Enterprise Support
Head of Customer Success & Enterprise Support

LiteLLM • San Francisco (CA)

On-site
USD 180,000 - 280,000