Senior AI Platform Engineering Lead

Coreweave; Livingston (NJ); On-site; USD 188,000 - 303,000; Full time

Benefits offered by this job

Health insurance (Medical, dental, and

401(k) with employer match

Employee Stock Purchase Program (ESPP)

Tuition reimbursement

Flexible PTO

Catered lunch

Job summary

CoreWeave is seeking a Senior Engineering Manager for the AI/ML Platform team to lead the group productizing and operating our inference offering. You will partner with CoreWeave’s AI platform team to deliver a polished, reliable product for practitioners deploying real-world AI workloads, including W&B Training.

You will combine strong leadership with execution clarity to raise reliability, accelerate workflows, and improve the developer experience across multiple teams.

Qualifications

• 7+ years of software engineering experience with at least 3+ years leading engineering teams.
• Fluent in concepts related to distributed compute services, including observability, autoscaling, reliability engineering, API design, and service operations.
• Comfortable balancing latency, reliability, cost, and development velocity amid competing priorities.
• Strong communication and alignment skills to lead cross-functional projects.
• Deep empathy for ML practitioners and platform developers to improve reliability and developer experience.

Responsibilities

• Lead and grow the engineering team responsible for evolving and operating the W&B Inference product.
• Drive execution on roadmap initiatives with Product for timely, robust delivery.
• Own engineering processes for the inference productization layer, including incident response and release management.
• Partner with infrastructure teams to integrate capabilities into a cohesive, user-facing product.
• Guide design and delivery of application-layer enhancements such as tracing and tool call handling.
• Ensure the offering meets reliability, usability, and performance standards while balancing cost and architecture constraints.
• Create clarity across cross-functional teams and foster ownership and continuous improvement.

Skills

Distributed systems

Observability

Reliability engineering

API design

Service operations

Leadership

Developer-platforms

Tools

Cloud infrastructure

IAM

Job description

CoreWeave is seeking a Senior Engineering Manager for the AI/ML Platform team to lead the group productizing and operating our inference offering. You will partner with CoreWeave’s AI platform team to deliver a polished, reliable product for practitioners deploying real-world AI workloads, including W&B Training.

You will combine strong leadership with execution clarity to raise reliability, accelerate workflows, and improve the developer experience across multiple teams.