Senior Product Manager – AI Infrastructure & Scale

Baseten

United States

Remote

USD 150,000 - 190,000

Full time

14 days+
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Baseten is seeking an experienced Product Manager to own production inference scalability and reliability. You will shape how deployments autoscale, route traffic, and manage failover across regions.

Work directly with founders and top engineers to define the roadmap for infrastructure and ML serving, translating complex systems into usable product experiences for customers. Expect a fast-moving environment, close collaboration with cross-functional teams, and a strong emphasis on performance,

Qualifications

  • 8+ years in product management, including deep experience with infrastructure, distributed systems, or ML serving.
  • You reason fluently about scaling, routing.

Responsibilities

  • Own deployments autoscale, traffic routing, failover, and cross-region scaling.
  • Define the product roadmap for infrastructure and ML serving, and observe deployments end-to-end.
  • Work with founders and engineers to set standards for great product experiences.

Job description

Baseten is seeking an experienced Product Manager to own production inference scalability and reliability. You will shape how deployments autoscale, route traffic, and manage failover across regions.

Work directly with founders and top engineers to define the roadmap for infrastructure and ML serving, translating complex systems into usable product experiences for customers. Expect a fast-moving environment, close collaboration with cross-functional teams, and a strong emphasis on performance,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Product Manager — AI Infrastructure & Scale
Senior Product Manager — AI Infrastructure & Scale

Baseten • San Francisco (CA)

On-site
USD 210,000 - 280,000
Competitive equity
Medical, dental, vision insurance
Flexible PTO including Winter Break
+4
Product Marketing Manager, AI Inference Platform
Product Marketing Manager, AI Inference Platform

Baseten • San Francisco (CA)

On-site
USD 170,000 - 220,000
Competitive compensation
Medical, dental, and vision insurance
Flexible PTO incl. Winter Break
+4
AI Inference Platform Product Marketing Lead
AI Inference Platform Product Marketing Lead

Socket.dev • San Francisco (CA)

On-site
USD 150,000 - 210,000
Competitive compensation
Medical, dental, vision insurance (US)
Flexible PTO with Winter Break
+4
Product Marketing Lead, AI Inference Platform
Product Marketing Lead, AI Inference Platform

Baseten • New York (NY)

On-site
USD 170,000 - 220,000
Competitive compensation
Equity
Health insurance
+4
AI Inference Platform Engineer — Production ML Tools
AI Inference Platform Engineer — Production ML Tools

Baseten • United States

Remote
USD 140,000 - 210,000
Equity
Medical insurance
Dental & Vision
+4
Product Manager - Developer Experience for AI Infra
Product Manager - Developer Experience for AI Infra

Baseten • San Francisco (CA)

On-site
USD 160,000 - 240,000
Competitive equity
Medical, dental & vision insurance
Flexible PTO including Winter Break
+4
Product Manager, Inference Platform
Product Manager, Inference Platform

The Consensus • New York (NY)

On-site
USD 120,000 - 160,000
Competitive compensation including equity
100% coverage of medical, dental, and vision insurance
Flexible PTO including Winter Break
+4
Product Manager, Inference Platform
Product Manager, Inference Platform

Baseten • San Francisco (CA)

On-site
USD 210,000 - 280,000
Competitive equity
Medical, dental, vision insurance
Flexible PTO including Winter Break
+4
Technical Program Manager — AI Inference Platform
Technical Program Manager — AI Inference Platform

Baseten • United States

Remote
USD 140,000 - 170,000
Scale AI Infra Engineer | Kubernetes & CI/CD
Scale AI Infra Engineer | Kubernetes & CI/CD

BaseTen • New York (NY), San Francisco (CA)

Hybrid
USD 160,000 - 210,000
Meaningful equity
100% medical, dental, vision coverage
Flexible PTO including Winter Break
+4