Senior Engineering Manager, AI Inference Platform

Coreweave; United States; Remote; USD 188,000 - 303,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

Company-paid Life Insurance

401(k) with generous match

Flexible PTO

Catered lunch

Casual work environment

Tuition Reimbursement

Equity / ESPP

Mental Wellness benefits

Job summary

CoreWeave seeks a Senior Engineering Manager for the AI/ML Platform to lead the team that productizes and operates the W&B Inference offering. You will partner with the CoreWeave AI platform team to deliver a polished, reliable, developer-friendly product for practitioners deploying real-world AI workloads.

You’ll guide engineers across reliability, observability, operational excellence, tooling, and application-layer enhancements, balancing cost, performance, and velocity while maintaining

Qualifications

• 7+ years in software engineering, incl. 3+ years leading teams for distributed systems and large-scale services.
• Fluent with distributed compute concepts: observability, autoscaling, reliability, APIs, and service operations.
• Comfortable with competing priorities and principled trade-offs among latency, reliability, cost and velocity.
• Strong communication and alignment across multi-stakeholder projects.

Responsibilities

• Lead and grow the team for the W&B Inference product, focusing on reliability and developer experience.
• Drive roadmap execution with Product to deliver platform capabilities.
• Own engineering processes for inference productization including incident response and release management.
• Partner with infrastructure teams to integrate capabilities from the inference platform into a cohesive, user-facing product.
• Guide design of application-layer enhancements such as tracing and tool calls.
• Ensure reliability, usability, compliance, and performance balancing cost and load.
• Create clear cross-functional communication and aligned priorities.
• Build a culture of ownership and continuous improvement within the engineering team.

Skills

Distributed systems

Engineering leadership

Observability

API design

Job description

CoreWeave seeks a Senior Engineering Manager for the AI/ML Platform to lead the team that productizes and operates the W&B Inference offering. You will partner with the CoreWeave AI platform team to deliver a polished, reliable, developer-friendly product for practitioners deploying real-world AI workloads.

You’ll guide engineers across reliability, observability, operational excellence, tooling, and application-layer enhancements, balancing cost, performance, and velocity while maintaining