AI Runtime Solutions Specialist: Inference & Sandboxes

CoreWeave; Livingston (NJ); On-site; USD 207,000 - 275,000; Full time

Benefits offered by this job

Medical Insurance

401(k)

Equity awards

Paid Parental Leave

Tuition Reimbursement

Flexible PTO

Job summary

CoreWeave seeks a Solution Specialist for AI Runtime Services to open new markets, drive early adoption, and translate customer needs into product feedback that shapes the roadmap.

You will own commercial and technical strategy for new customer wins in AI runtime infrastructure, focusing on performance, isolation, and cost efficiency across deployment patterns while partnering with product and engineering to improve the platform.

Qualifications

• 10+ years in distributed systems, ML infrastructure, or production AI engineering.
• 5+ years with AI runtime systems in customer-facing roles.
• Deep knowledge of runtime execution, frameworks, batching, and latency/throughput at scale.

Responsibilities

• Own the commercial and technical strategy for net new customer wins in AI runtime infrastructure.
• Drive new business opportunities where inference latency and throughput are bottlenecks.
• Develop deep expertise across the AI runtime landscape and benchmark runtime performance.
• Translate customer requirements into product feedback shaping the roadmap for AI Runtime Services.
• Develop deal structures, technical playbooks, and benchmark narratives to accelerate opportunities.
• Engage with enterprise buyers as the voice on runtime performance, cost-per-token, and architecture decisions.
• Design the commercial framework for large-scale runtime deployments, including throughput and SLA structures.
• Partner with product and infra teams to maintain a competitive edge in runtime efficiency.

Skills

Distributed systems

ML infrastructure

AI runtime systems

Model serving

Inference optimization

Containerized workloads

Kubernetes

Sandboxed execution

GPU memory management

Cost-per-token economics

Education

Advanced degree in CS/ML/Engineering

Tools

vLLM

TensorRT-LLM

Triton

Kubernetes

Job description

CoreWeave seeks a Solution Specialist for AI Runtime Services to open new markets, drive early adoption, and translate customer needs into product feedback that shapes the roadmap.

You will own commercial and technical strategy for new customer wins in AI runtime infrastructure, focusing on performance, isolation, and cost efficiency across deployment patterns while partnering with product and engineering to improve the platform.