AI Inference Platform TPM - Scale & Launch

CoreWeave; New York (NY); On-site; USD 198,000 - 264,000; Full time

Benefits offered by this job

Medical Insurance

Dental & Vision

Paid Parental Leave

401(k) Matching

ESPP

Tuition Reimbursement

Flexible PTO

Job summary

CoreWeave is seeking an AI/ML Technical Program Manager focused on inference to lead cross-functional initiatives across the platform. You will partner with Engineering, Product, Infrastructure, and Go-to-Market teams to deliver scalable, reliable inference services for serverless and dedicated use cases, aligning deliverables with customer outcomes and business goals.

The role emphasizes end-to-end launch readiness, onboarding programs, performance optimization, and measurable reliability.

Qualifications

• Bachelor's degree in a technical field or equivalent practical experience.
• 8+ years of technical program management in distributed systems, cloud infra, or AI/ML platforms.
• Experience delivering large-scale infrastructure programs end-to-end in cross-functional settings.
• Strong fluency in inference systems, GPU compute, cloud-native architectures, and performance optimization.
• Proven ability to improve reliability, performance, and customer delivery.
• Excellent written and verbal communication to align multiple stakeholders.
• Experience with inference-serving systems, model onboarding, rollout strategies, and observability tooling.
• Familiarity with launch readiness, incident follow-through, and release validation.

Responsibilities

• Drive end-to-end program management for inference platform initiatives spanning reliability, onboarding, launch readiness, and runtime optimization.
• Lead cross-functional onboarding programs across dedicated and serverless inference offerings.
• Coordinate launch readiness for new inference capabilities with alignment on outcomes and supportability.
• Define and deliver roadmap outcomes for latency, throughput, uptime, and price-performance.
• Coordinate multi-team execution across platform, infra, and customer-facing teams.
• Build and operate success metrics, dashboards, and launch gates to measure reliability and onboarding readiness.
• Establish repeatable processes for release validation and postmortem follow-through.
• Unify operational processes and support mechanisms across inference deployment models.
• Create clear communication channels between Engineering, Product, Infra, and Go-to-Market teams.

Skills

Technical Program Management

Distributed Systems

Cloud Infrastructure

AI/ML Platform

Inference Serving

Cross-functional Leadership

Performance Optimization

Observability & Metrics

Launch Readiness

Education

Bachelor's degree in a technical field

Tools

GPU Compute

Job description

CoreWeave is seeking an AI/ML Technical Program Manager focused on inference to lead cross-functional initiatives across the platform. You will partner with Engineering, Product, Infrastructure, and Go-to-Market teams to deliver scalable, reliable inference services for serverless and dedicated use cases, aligning deliverables with customer outcomes and business goals.

The role emphasizes end-to-end launch readiness, onboarding programs, performance optimization, and measurable reliability.