Senior AI/ML Platform Engineering Manager (Inference)

CoreWeave; New York (NY); On-site; USD 188,000 - 303,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

Company-paid Life Insurance

401(k) with generous match

Paid Parental Leave

Flexible PTO

Catered lunch daily

Job summary

CoreWeave is seeking a Senior Engineering Manager for the AI/ML Platform team to lead the W&B Inference product engineering efforts, ensuring reliability and a developer-friendly experience.

You will guide cross-functional teams with Product, Design, Support, and GTM stakeholders to deliver measurable improvements, scale production workloads, and balance latency, cost, and development velocity for real-world AI deployments.

Qualifications

• 7+ years in software engineering with leadership of distributed systems.
• 3+ years managing engineering teams responsible for large-scale services.
• Strong knowledge of observability, reliability, and API design.

Responsibilities

• Lead and grow the engineering team responsible for evolving and operating the W&B Inference product, focusing on service reliability, orchestration, operational maturity, and developer experience.
• Drive execution on roadmap initiatives in close partnership with Product, ensuring platform capabilities are delivered predictably, robustly, and with measurable customer impact.
• Own the engineering processes for the inference productization layer, including incident response, operational readiness, release management, observability, and engineering quality.
• Partner with CoreWeave’s infrastructure teams to integrate capabilities from the underlying inference platform into a cohesive, user-facing product.
• Guide the design and delivery of application-layer enhancements such as tracing and tool call handling.
• Ensure the inference offering meets high standards of reliability, usability, compliance, and performance, balancing trade-offs across cost, operational load, and architectural constraints.

Skills

Distributed systems leadership

Observability

API design

Reliability engineering

Communication

Job description

CoreWeave is seeking a Senior Engineering Manager for the AI/ML Platform team to lead the W&B Inference product engineering efforts, ensuring reliability and a developer-friendly experience.

You will guide cross-functional teams with Product, Design, Support, and GTM stakeholders to deliver measurable improvements, scale production workloads, and balance latency, cost, and development velocity for real-world AI deployments.