Product Manager - AI Model Routing Platform

Baseten

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive compensation & equity
Insurance coverage (medical/dental/vis
Flexible PTO
Parental leave
Fertility stipend
401(k) plan (U.S. only)
Learning opportunities

Job summary

Baseten is hiring a Product Manager for Grid to build the next generation of AI infrastructure. You will own the Grid roadmap, collaborate with researchers and engineers, and shape how developers control intelligent routing across models, aiming to improve quality, speed, and cost for production AI applications.

You’ll work directly with customers, be responsible for onboarding experiences, and help turn early pilots into sustained adoption and revenue growth, with a focus on enterprise-scale

Qualifications

  • Experience building and commercializing AI/ML products or developer platforms, with adoption or business impact.
  • Technical background in software engineering, ML engineering, research, or equivalent hands-on experience.
  • Experience working with researchers or ML engineers on model behavior, evaluation, or learned systems in production.
  • Strong understanding of AI model quality, latency, cost, and tradeoffs involved in optimizing across them.
  • Excellent developer product instincts, with an appreciation for both simple APIs and enterprise-level controls.
  • Hands-on experience using coding agents and a strong point of view on where automation helps developers and where they need control.

Responsibilities

  • Own the Grid product roadmap, from early developer adoption to production deployments and enterprise expansion.
  • Work with researchers and engineers to improve intelligent model selection, routing policies, fallbacks, and controls.
  • Build evaluation frameworks that measure real-world outcomes, including task quality, completion time, latency, and total cost.
  • Shape the developer experience for onboarding, configuration, observability, and routing decisions.
  • Help customers understand why a model was selected and give them confidence and control over how routing behaves.
  • Work through technical challenges involving conversation history, tool compatibility, prompt caching, retries, and routing overhead.
  • Partner with GTM and customers to turn early pilots into sustained adoption and revenue growth.

Skills

AI/ML product experience
Developer platforms
Engineering background
Customer collaboration

Education

Bachelor's degree in CS or related field

Tools

Coding agents
Model routing
ML tooling

Job description

Baseten is hiring a Product Manager for Grid to build the next generation of AI infrastructure. You will own the Grid roadmap, collaborate with researchers and engineers, and shape how developers control intelligent routing across models, aiming to improve quality, speed, and cost for production AI applications.

You’ll work directly with customers, be responsible for onboarding experiences, and help turn early pilots into sustained adoption and revenue growth, with a focus on enterprise-scale

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Product Manager, AI Model Routing Platform
Product Manager, AI Model Routing Platform

Ativesite • San Francisco (CA)

On-site
USD 140,000 - 190,000
Competitive compensation and equity
Medical, dental, vision insurance (U.S
Flexible PTO including Winter Break
+4
Product Manager, AI Model Routing — Grid Platform, Equity
Product Manager, AI Model Routing — Grid Platform, Equity

Black.ai • New York (NY)

On-site
USD 140,000 - 210,000
Equity
Medical, dental, vision insurance
Flexible PTO
+3
Product Manager | AI Model Routing
Product Manager | AI Model Routing

present of AI • San Francisco (CA)

On-site
USD 120,000 - 180,000
Product Manager, Grid
Product Manager, Grid

present of AI • San Francisco (CA)

On-site
USD 120,000 - 180,000
Product Manager, Grid
Product Manager, Grid

Baseten • San Francisco (CA)

On-site
USD 180,000 - 240,000
Competitive compensation & equity
Insurance coverage (medical/dental/vis
Flexible PTO
+4
Product Manager, Grid
Product Manager, Grid

Black.ai • New York (NY)

On-site
USD 140,000 - 210,000
Equity
Medical, dental, vision insurance
Flexible PTO
+3
Product Manager, Grid
Product Manager, Grid

Ativesite • San Francisco (CA)

On-site
USD 140,000 - 190,000
Competitive compensation and equity
Medical, dental, vision insurance (U.S
Flexible PTO including Winter Break
+4
Remote GenAI Product Manager for Enterprise Grid AI
Remote GenAI Product Manager for Enterprise Grid AI

Blackhornvc • United States

Remote
USD 160,000 - 200,000
Senior AI Platform Product Manager
Senior AI Platform Product Manager

Black.ai • San Francisco (CA)

On-site
USD 180,000 - 260,000
Competitive compensation with equity
100% medical, dental, vision for you &
Flexible PTO including Winter Break
+4
Product Manager, AI Training Platform
Product Manager, AI Training Platform

Black.ai • San Francisco (CA)

Hybrid
USD 150,000 - 210,000
Competitive compensation
Equity
100% medical, dental, vision for US E
+5