AI Runtime Solutions Architect

CoreWeave; Sunnyvale (CA); On-site; USD 207,000 - 275,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

Company-paid Life Insurance

401(k) with generous match

Flexible PTO

Catered lunch every day

Casual work environment

Job summary

CoreWeave, the Essential Cloud for AI, seeks a Solution Specialist for AI Runtime Services in Sunnyvale. You will own commercial and technical strategy to win new AI runtime deployments, translating customer requirements into product feedback and roadmaps, while working with engineering, sales, and solutions architecture to accelerate early-adopter adoption.

You will build playbooks, benchmarks, and deal structures for enterprise-grade, multi-tenant AI workloads, focusing on throughput, latency,

Qualifications

• 10+ years of experience in distributed systems, ML infrastructure, or production AI engineering.
• 5+ years working with AI runtime systems in a customer-facing or deal-shaping capacity.
• Deep knowledge of runtime execution: serving frameworks, batching, and GPU memory management.
• Experience with sandboxed and isolated execution environments and multi-tenant scheduling.
• Strong understanding of GPU memory hierarchies and cost/latency tradeoffs for enterprise customers.
• Familiarity with Kubernetes-native runtime orchestration and workload portability.
• Ability to benchmark, explain, and commercially position runtime performance differences.

Responsibilities

• Own the commercial and technical strategy for net new customer wins in AI runtime infrastructure.
• Drive opportunities where latency, throughput, isolation, or complexity hinder scaling.
• Develop deep expertise across AI runtime landscape and translate learnings to product roadmaps.
• Translate customer requirements into product feedback shaping AI Runtime Services roadmap.
• Develop deal structures, technical playbooks, and benchmark narratives for sales and SA teams.
• Engage with enterprise buyers as the authoritative voice on runtime tradeoffs and economics.
• Design the commercial framework for large-scale runtime deployments and SLAs.
• Partner with product and infra teams to maintain a competitive edge on efficiency.

Skills

Distributed systems

ML infrastructure

Production AI engineering

AI runtime systems

Model serving

Containerized workloads

Kubernetes-native runtime orches

Benchmarking runtime performance

Education

Advanced degree in CS/ML/Engineering

Tools

vLLM

TensorRT-LLM

Triton

Job description

CoreWeave, the Essential Cloud for AI, seeks a Solution Specialist for AI Runtime Services in Sunnyvale. You will own commercial and technical strategy to win new AI runtime deployments, translating customer requirements into product feedback and roadmaps, while working with engineering, sales, and solutions architecture to accelerate early-adopter adoption.

You will build playbooks, benchmarks, and deal structures for enterprise-grade, multi-tenant AI workloads, focusing on throughput, latency,