Inference Platform TPM: Scale AI Delivery & Reliability

CoreWeave; Livingston (NJ); On-site; USD 198,000 - 264,000; Full time

Benefits offered by this job

Medical insurance

Dental & vision coverage

ESPP - Employee Stock Purchase Program

401(k) with match

Flexible PTO

Tuition reimbursement

Life insurance

Parental leave

Job summary

CoreWeave is seeking an experienced AI/ML Technical Program Manager to lead inference platform programs. You will partner with Product, Engineering, Research, Infrastructure, and GTM to deliver scalable, reliable AI infrastructure and platform capabilities used by researchers, engineers, and enterprises.

You will drive onboarding, launch readiness, and runtime optimization for serverless and dedicated inference, maintaining strong metrics and coordination across teams in a fast-growing

Qualifications

• 8+ years of technical program management experience in distributed systems, cloud infrastructure, or AI/ML platform engineering.
• Proven ability to drive large-scale infrastructure or platform programs from concept to production.
• Strong technical fluency in inference systems, GPU compute, cloud-native architectures, and performance optimization.
• Excellent written and verbal communication to align multiple stakeholders.
• Experience with inference-serving systems, rollout strategies, and observability tooling.

Responsibilities

• Drive end-to-end program management for inference platform initiatives spanning reliability, onboarding, launch readiness, and runtime optimization.
• Lead cross-functional onboarding programs for dedicated and serverless inference offerings with clear ownership and readiness.
• Coordinate launch readiness for new inference capabilities and align teams around customer outcomes and validation.
• Define and deliver roadmap outcomes for latency, throughput, uptime, and price-performance.
• Build metrics, dashboards, launch gates, and review cadences to measure reliability and quality.
• Establish repeatable release validation processes and postmortem follow-through.
• Unify operational processes and support across inference deployment models and onboarding paths.
• Create communication channels between Engineering, Product, Infrastructure, and Go-to-Market for predictable outcomes.

Skills

PM experience

Distributed systems

Cloud infra

AI/ML platform

Cross-functional

Communication

Education

Bachelor's degree in a technical field or equivalent practical experience

Job description

CoreWeave is seeking an experienced AI/ML Technical Program Manager to lead inference platform programs. You will partner with Product, Engineering, Research, Infrastructure, and GTM to deliver scalable, reliable AI infrastructure and platform capabilities used by researchers, engineers, and enterprises.

You will drive onboarding, launch readiness, and runtime optimization for serverless and dedicated inference, maintaining strong metrics and coordination across teams in a fast-growing