Product Manager, AI Model Routing Platform

Ativesite

San Francisco (CA)

On-site

USD 140,000 - 190,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive compensation and equity
Medical, dental, vision insurance (U.S
Flexible PTO including Winter Break
Paid parental leave
Fertility and family-building stipend
Company 401(k) matching (U.S.)
Exposure to ML startups and learning

Job summary

Baseten is hiring a Product Manager for Grid to define the next generation of AI infrastructure. You’ll own the product roadmap, work with researchers and engineers to optimize model routing, and build evaluation frameworks that prove impact for developers and production workloads.

You’ll partner with customers and GTM teams to scale early pilots into enterprise adoption, balancing speed, quality, and cost while shaping the developer experience and controls across the platform.

Qualifications

  • Experience building and commercializing AI/ML products or developer platforms with measurable impact.
  • Technical background in software engineering, ML engineering, research, or equivalent hands-on experience.
  • Experience collaborating with researchers or ML engineers on model behavior, evaluation, or learned systems in production.
  • Strong understanding of AI model quality, latency, and cost tradeoffs.

Responsibilities

  • Own the product roadmap for Grid, from early developer adoption to production deployments and enterprise expansion.
  • Collaborate with researchers and engineers to improve intelligent model selection, routing policies, fallbacks, and controls.
  • Build evaluation frameworks that measure real-world outcomes (quality, time, latency, cost).
  • Shape developer experience for onboarding, configuration, observability, and routing decisions.
  • Help customers understand why a model was selected and provide control over routing behavior.
  • Address technical challenges around conversation history, tool compatibility, prompt caching, retries, and routing overhead.
  • Partner with GTM and customers to convert pilots into sustained adoption and revenue growth.

Skills

AI/ML product
Developer platforms
Product roadmap
Model routing
Customer collaboration

Tools

Coding agents

Job description

Baseten is hiring a Product Manager for Grid to define the next generation of AI infrastructure. You’ll own the product roadmap, work with researchers and engineers to optimize model routing, and build evaluation frameworks that prove impact for developers and production workloads.

You’ll partner with customers and GTM teams to scale early pilots into enterprise adoption, balancing speed, quality, and cost while shaping the developer experience and controls across the platform.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Product Manager - AI Model Routing Platform
Product Manager - AI Model Routing Platform

Baseten • San Francisco (CA)

On-site
USD 180,000 - 240,000
Competitive compensation & equity
Insurance coverage (medical/dental/vis
Flexible PTO
+4
Product Manager, AI Model Routing — Grid Platform, Equity
Product Manager, AI Model Routing — Grid Platform, Equity

Black.ai • New York (NY)

On-site
USD 140,000 - 210,000
Equity
Medical, dental, vision insurance
Flexible PTO
+3
Product Manager, Grid
Product Manager, Grid

present of AI • San Francisco (CA)

On-site
USD 120,000 - 180,000
Product Manager | AI Model Routing
Product Manager | AI Model Routing

present of AI • San Francisco (CA)

On-site
USD 120,000 - 180,000
Product Manager, Grid
Product Manager, Grid

Baseten • San Francisco (CA)

On-site
USD 180,000 - 240,000
Competitive compensation & equity
Insurance coverage (medical/dental/vis
Flexible PTO
+4
Product Manager, Grid
Product Manager, Grid

Black.ai • New York (NY)

On-site
USD 140,000 - 210,000
Equity
Medical, dental, vision insurance
Flexible PTO
+3
Product Manager, Grid
Product Manager, Grid

Ativesite • San Francisco (CA)

On-site
USD 140,000 - 190,000
Competitive compensation and equity
Medical, dental, vision insurance (U.S
Flexible PTO including Winter Break
+4
Senior AI Platform Product Manager
Senior AI Platform Product Manager

Black.ai • San Francisco (CA)

On-site
USD 180,000 - 260,000
Competitive compensation with equity
100% medical, dental, vision for you &
Flexible PTO including Winter Break
+4
Product Manager, AI Training Platform
Product Manager, AI Training Platform

Black.ai • San Francisco (CA)

Hybrid
USD 150,000 - 210,000
Competitive compensation
Equity
100% medical, dental, vision for US E
+5
Senior Product Manager, AI Inference Platform
Senior Product Manager, AI Inference Platform

AItoolnavio • San Francisco (CA)

On-site
USD 170,000 - 250,000
Competitive compensation
Equity
Medical, dental, vision insurance for
+5