AI Inference Platform TPM — Launch, Onboard & Scale

Coreweave; New York (NY); On-site; USD 177,000 - 237,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

Life Insurance

Equity / Stock awards

401(k) match

Flexible PTO

Tuition reimbursement

ESPP

Mental wellness benefits

Parental leave

Lunch provided in office

Job summary

CoreWeave is hiring a Technical Program Manager focused on inference to lead cross-functional programs spanning inference platform delivery, customer onboarding, launch readiness, and runtime optimization. You will partner with engineering, product, infrastructure, and GTM teams to deliver scalable, reliable inference services for serverless and dedicated use cases.

The role requires 8+ years of TPM experience in distributed systems, cloud infrastructure, or AI/ML platforms, with strong

Qualifications

• Bachelor’s degree in a technical field or equivalent practical experience.
• 8+ years of technical program management experience in distributed systems, cloud infrastructure, or AI/ML platform engineering.
• Proven experience driving large-scale infrastructure or platform programs from concept to production in cross-functional environments.
• Strong technical fluency in distributed inference systems, GPU compute, cloud-native architectures, and performance optimization.
• Demonstrated success improving reliability, performance, or customer delivery.
• Excellent written and verbal communication skills.
• Experience with inference-serving systems, model onboarding workflows, rollout strategies, and observability tooling.
• Familiarity with launch readiness, incident follow-through, and release validation for production.
• Experience operating in high-growth environments with parallel roadmaps and commitments.

Responsibilities

• Drive end-to-end program management for inference platform initiatives including reliability, onboarding, launch readiness, and runtime optimization.
• Lead cross-functional onboarding programs for dedicated and serverless inference offerings with clear ownership and criteria.
• Drive launch readiness for new inference capabilities with alignment on outcomes, supportability, and validation.
• Define and deliver roadmap outcomes for latency, throughput, uptime, and price-performance.
• Coordinate multi-team execution across platform, infrastructure, and customer-facing teams.
• Build success metrics, dashboards, launch gates, and review cadences for reliability and quality.
• Establish repeatable release validation, performance regression tracking, and postmortem follow-through.
• Unify operational processes and support across inference deployment models and onboarding paths.
• Create strong channels between Engineering, Product, Infrastructure, and Go-to-Market teams.

Skills

Technical program management

Distributed systems

Cloud infrastructure

AI/ML platform engineering

Reliability improvements

Communication

Inference-serving systems

Launch readiness

Education

Bachelor’s degree in a technical field

Tools

Observability tooling

Dashboards

Job description

CoreWeave is hiring a Technical Program Manager focused on inference to lead cross-functional programs spanning inference platform delivery, customer onboarding, launch readiness, and runtime optimization. You will partner with engineering, product, infrastructure, and GTM teams to deliver scalable, reliable inference services for serverless and dedicated use cases.

The role requires 8+ years of TPM experience in distributed systems, cloud infrastructure, or AI/ML platforms, with strong