Senior Product Manager — AI Infrastructure & Scale

Baseten; San Francisco (CA); On-site; USD 210,000 - 280,000; Full time

Benefits offered by this job

Competitive equity

Medical, dental, vision insurance

Flexible PTO including Winter Break

Paid parental leave

Fertility stipend

401(k)

Exposure to ML startups

Job summary

Baseten in San Francisco builds a platform to ship AI models at scale. We’re looking for a senior product manager to own infrastructure-focused features like deployment autoscaling, traffic routing, and multi-region failover.

You’ll work with engineers and customers to define end-to-end product experiences—from backend surface area to UX observations. You’ll drive cross-team roadmaps, own end-to-end capabilities, and help define Baseten’s roadmap as the product evolves in a fast-growing AI

Qualifications

• 8+ years in product management with infra, distributed systems, or ML serving.
• Ability to reason about scaling, routing, failover, and cost/performance frontier.
• End-to-end ownership from backend to UX.
• Cross-team roadmap leadership and defining new categories.

Responsibilities

• Own the surface for deployment scale: autoscale, traffic routing, failover, and multi-cluster workloads.
• Define and drive the roadmap for infrastructure and product teams.
• Ensure production inference is reliable by default with region-aware routing and multi-region deployments.
• Build release mechanics for canary/shadow/A/B testing, warm-ups, drains, and probes.
• Push the cost/performance frontier for serving AI at scale with measurable MTTR reductions.

Skills

PM with infra focus

Scaling & routing

End-to-end ownership

Cross-team roadmaps

Tools

Kubernetes

ML serving

Job description

Baseten in San Francisco builds a platform to ship AI models at scale. We’re looking for a senior product manager to own infrastructure-focused features like deployment autoscaling, traffic routing, and multi-region failover.

You’ll work with engineers and customers to define end-to-end product experiences—from backend surface area to UX observations. You’ll drive cross-team roadmaps, own end-to-end capabilities, and help define Baseten’s roadmap as the product evolves in a fast-growing AI