Product Manager, Inference Experience

present of AI

San Francisco (CA)

On-site

USD 140,000 - 200,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Baseten is seeking a product leader to own the developer-facing side of our high-performance inference platform in San Francisco. You’ll guide how developers find, test, deploy, and operate models in production, balancing speed, quality, and cost.

You’ll translate complex tech work into products developers actually adopt, focusing on API design, tooling, and a smooth UX for experimentation and deployment at scale.

Qualifications

  • Deep hands-on work with model serving frameworks.
  • Record of turning technical work into products that developers actually adopt.
  • Experience balancing latency, throughput, and cost in production.

Responsibilities

  • Own the developer-facing side of Baseten's inference platform.
  • Evaluate models and workloads for production deployment.
  • Design APIs and tooling to streamline testing, deployment, and monitoring.

Skills

Model serving frameworks
GPU cost tradeoffs
Technical product background
Developer adoption

Tools

APIs

Job description

This role owns the developer facing side of an inference platform, covering how people find models, try them, deploy them, and keep them running in production. A strong candidate has deep hands on work with model serving frameworks and a clear grasp of GPU cost and the tradeoffs between speed, quality, and price. They also bring a record of turning technical work into products that developers actually adopt.

How it fits the AI era

Inference is where AI models meet real users, so the work sits close to the cost and reliability questions that decide whether an AI product ships. Much of the routine tuning and benchmarking can be automated, which shifts the product manager toward judgment about which models and workloads matter and how to make the path feel simple. The human part is taste in developer experience and reading what customers find frustrating.

How it builds AI experience

The role offers direct exposure to serving open source and custom models at scale, including evaluation, optimization, and operating them in production. Someone building toward it could deploy models with common serving frameworks, measure latency and throughput against cost, and study how developer tools like APIs and consoles are designed. Working with real inference workloads and reading how teams put models into production would help.

Worth showing
  • Model serving frameworks
  • GPU cost tradeoffs
  • Technical product background
  • Adoption and launch record
About Baseten

High-performance cloud inference platform for deploying, serving, and scaling open-source and custom artificial intelligence models.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Product Manager, Training Platform
Product Manager, Training Platform

present of AI • San Francisco (CA)

On-site
USD 180,000 - 260,000
Technical Product Marketing Manager
Technical Product Marketing Manager

present of AI • San Francisco (CA)

On-site
USD 120,000 - 180,000
Technical Program Manager, Forward Deployed Engineering
Technical Program Manager, Forward Deployed Engineering

present of AI • San Francisco (CA)

Remote
USD 120,000 - 180,000
Product Platform: Backend Engineer
Product Platform: Backend Engineer

present of AI • San Francisco (CA)

On-site
USD 140,000 - 200,000
Product Manager, AI Inference Platform at Scale
Product Manager, AI Inference Platform at Scale

Black.ai • New York (NY)

On-site
USD 160,000 - 240,000
Equity
Medical, dental, vision insurance (US)
Flexible PTO
+3
Product Manager, Pricing and Monetization
Product Manager, Pricing and Monetization

present of AI • San Francisco (CA)

On-site
USD 150,000 - 210,000
Product Manager, AI Inference & Dev Experience
Product Manager, AI Inference & Dev Experience

present of AI • San Francisco (CA)

On-site
USD 140,000 - 200,000
Product Manager, AI Inference Platform
Product Manager, AI Inference Platform

Baseten • San Francisco (CA)

On-site
USD 180,000 - 240,000
Competitive equity & compensation
US medical/dental/vision coverage for
Flexible PTO including Winter Break
+4
Product Manager, AI Inference - Scale & Performance
Product Manager, AI Inference - Scale & Performance

AItoolnavio • San Francisco (CA)

On-site
USD 150,000 - 190,000
Equity & competitive compensation
Health insurance (US)
Flexible PTO (Winter Break)
+3
Product Manager, Grid
Product Manager, Grid

present of AI • San Francisco (CA)

On-site
USD 120,000 - 180,000