Inference Platform TPM — Lead Scalable AI Delivery

CoreWeave; Bellevue (WA); On-site; USD 198,000 - 264,000; Full time

Benefits offered by this job

Medical benefits

401(k) with match

ESPP

Flexible PTO

Tuition reimbursement

Lunch provided

Parental leave

Job summary

CoreWeave is seeking an experienced AI/ML Technical Program Manager (Inference) to lead cross-functional programs across inference platform delivery, customer onboarding, launch readiness, and runtime optimization.

You will partner with Engineering, Product, Infrastructure, and Go-to-Market teams to drive scalable, reliable production inference services for serverless and dedicated use cases, ensuring strong price-performance and low operational friction.

Qualifications

• 8+ years of technical program management experience in distributed systems or AI/ML platform engineering.
• Proven experience driving large-scale infrastructure programs from concept to production.
• Strong technical fluency in distributed inference systems, GPU compute, and cloud-native architectures.
• Excellent written and verbal communication to align stakeholders across teams.

Responsibilities

• Drive end-to-end programs for inference platform initiatives spanning reliability, onboarding, launch readiness, and runtime optimization.
• Lead cross-functional onboarding programs for customer onboarding across serverless and dedicated inference offerings.
• Drive launch readiness for new inference capabilities by aligning teams around customer outcomes.
• Partner with engineering and product to define and deliver roadmap outcomes for latency, throughput, uptime, and cost performance.
• Coordinate multi-team execution across platform, infrastructure, and customer-facing teams to deliver reliable services.
• Build and operationalize success metrics, dashboards, launch gates, and review cadences for reliability and onboarding.
• Establish repeatable processes for release validation, performance regression tracking, and postmortem follow-through.
• Help unify operational processes and support across inference deployment models and onboarding paths.
• Create strong communication channels between Engineering, Product, Infrastructure, and Go-to-Market teams.

Skills

Distributed systems

Cloud infrastructure

AI/ML platform

Program management

Cross-functional leadership

Latency optimization

Observability tooling

Education

Bachelor's degree in technical field

Tools

Inference-serving systems

GPU compute

Observability tooling

Job description

CoreWeave is seeking an experienced AI/ML Technical Program Manager (Inference) to lead cross-functional programs across inference platform delivery, customer onboarding, launch readiness, and runtime optimization.

You will partner with Engineering, Product, Infrastructure, and Go-to-Market teams to drive scalable, reliable production inference services for serverless and dedicated use cases, ensuring strong price-performance and low operational friction.