Product Manager - AI Deployment & Production Serving

Mosaic.tech; San Francisco (CA); On-site; USD 300,000 - 450,000; Full time

Benefits offered by this job

Health, dental, and vision benefits

Unlimited PTO

Parental leave

Relocation support

Job summary

Thinking Machines is seeking a Product Manager for Deployment in San Francisco to own how models and Tinker-trained checkpoints move from training to production. You will shape inference infrastructure, APIs, latency budgets, and observability, partnering with researchers, engineers, and GTM to define workflows and success metrics.

The role emphasizes building a fast, predictable deployment experience, with strong emphasis on reliability, cost tradeoffs, and scalable systems as usage grows.

Qualifications

• Own production ML serving and deployment product with reliability, scaling, or performance decisions.
• Work deeply with production systems—latency, throughput, autoscaling, rollback, and incident response.
• Translate technical product goals into reliable, scaled production use.

Responsibilities

• Own deployment strategy, roadmap, and success metrics for models and checkpoints.
• Define priority deployment paths and workflows across model serving, autoscaling, versioning, and monitoring.
• Collaborate with infrastructure, research, engineering, and GTM to deliver end-to-end deployment.
• Build feedback loops with users deploying models in production and prioritize improvements.
• Drive end-to-end initiatives from scoping to incident learning, ensuring reliable rollouts.

Skills

Production ML deployment

Reliability engineering

Latency optimization

Tools

Model serving frameworks

GPU scheduling

Batching

Job description

Thinking Machines is seeking a Product Manager for Deployment in San Francisco to own how models and Tinker-trained checkpoints move from training to production. You will shape inference infrastructure, APIs, latency budgets, and observability, partnering with researchers, engineers, and GTM to define workflows and success metrics.

The role emphasizes building a fast, predictable deployment experience, with strong emphasis on reliability, cost tradeoffs, and scalable systems as usage grows.