Senior Inference Platform TPM — AI Infra Leadership

Coreweave; Bellevue (WA); On-site; USD 177,000 - 237,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance—

100% paid insurance

401(k) with generous employer match

Tuition Reimbursement

ESPP

Paid Parental Leave

Catered lunch each day

Flexible PTO

Casual work environment

Job summary

CoreWeave’s AI/ML Platform Services group is seeking a Technical Program Manager focused on inference to drive multi-team programs from onboarding to runtime optimization. You will lead cross-functional efforts spanning reliability, launch readiness, and performance improvements for scalable inference services.

You will collaborate with Engineering, Product, Infrastructure, and Go-to-Market teams to optimize latency, throughput, uptime, and price-performance while ensuring customer-focused

Qualifications

• 8+ years of technical program management experience in distributed systems, cloud infrastructure, or AI/ML platform engineering.
• Proven experience driving large-scale infrastructure or platform programs from concept to production in complex, cross-functional environments.
• Strong technical fluency in distributed inference systems, GPU compute, cloud-native architectures, and performance optimization.
• Demonstrated success driving measurable improvements in reliability, performance, operational readiness, or customer delivery.
• Excellent written and verbal communication skills, with the ability to align engineering, product, infrastructure, and customer-facing stakeholders around shared goals.
• Experience with inference-serving systems, model onboarding workflows, rollout strategies, and observability tooling.
• Familiarity with launch readiness, supportability, incident follow-through, and release validation for production infrastructure or platform services.
• Understanding of customer onboarding for technical products, especially where platform capabilities, infrastructure readiness, and support processes must align for launch.
• Experience operating in high-growth environments where roadmap execution, reliability expectations, and customer commitments must be managed in parallel.

Responsibilities

• Drive end-to-end program management for inference platform initiatives spanning reliability, customer onboarding, launch readiness, and runtime optimization.
• Lead cross-functional onboarding programs for dedicated and serverless inference offerings, ensuring clear ownership, launch criteria, and readiness for strategic customer use cases.
• Drive launch readiness for new inference capabilities by aligning teams around real customer outcomes, supportability, and end-to-end validation.
• Partner with engineering and product to define and deliver roadmap outcomes for latency, throughput, uptime, operational quality, and price-performance.
• Coordinate multi-team execution across platform, infrastructure, and customer-facing teams to deliver reliable and scalable inference services.
• Build and operationalize success metrics, dashboards, launch gates, and review cadences to measure service reliability, onboarding readiness, efficiency, and quality across the inference stack.
• Establish repeatable processes for release validation, performance regression tracking, launch management, and postmortem follow-through.
• Help unify operational processes, support mechanisms, and execution visibility across inference deployment models and customer onboarding paths.
• Create strong communication channels between Engineering, Product, Infrastructure, and Go-to-Market teams to align priorities and deliver predictable, high-impact outcomes.

Skills

Distributed systems

Cloud infrastructure

AI/ML platform

Technical program management

Cross-functional leadership

Communication skills

Observability tooling

Performance optimization

Education

Bachelor's degree in a technical field

Tools

Serverless platforms

Job description

CoreWeave’s AI/ML Platform Services group is seeking a Technical Program Manager focused on inference to drive multi-team programs from onboarding to runtime optimization. You will lead cross-functional efforts spanning reliability, launch readiness, and performance improvements for scalable inference services.

You will collaborate with Engineering, Product, Infrastructure, and Go-to-Market teams to optimize latency, throughput, uptime, and price-performance while ensuring customer-focused