AI Runtime Solutions Architect

CoreWeave; New York (NY); On-site; USD 130,000 - 160,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance fully covered

Company-paid Life Insurance

Flexible PTO

401(k) with employer match

Tuition Reimbursement

Job summary

CoreWeave is seeking a Solution Specialist for AI Runtime Services in New York, NY. This role focuses on launching new runtime services like Inference and Sandboxes to new customers. You will drive technical and commercial strategies and engage with major buyers to operationalize AI with low-latency and high-throughput solutions.

Candidates should have over 10 years of relevant experience, along with in-depth knowledge of AI processing frameworks and deployment strategies.

Qualifications

• 10+ years of experience in distributed systems, ML infrastructure, or production AI engineering.
• 5+ years working with AI runtime systems in a customer-facing role.
• Knowledge of GPU memory management and performance tradeoffs for throughput and latency.

Responsibilities

• Own the commercial and technical strategy for new customer wins.
• Drive business opportunities overcoming scaling barriers.
• Engage directly with enterprise and research buyers.

Skills

Distributed systems

ML infrastructure

AI engineering

Model serving

Inference optimization

Containerized workload execution

Real-time ML pipelines

Kubernetes-native orchestration

Benchmarking runtime performance

Customer engagement

Education

Bachelor's or advanced degree in Computer Science, Machine Learning, or Engineering

Tools

TensorRT-LLM

vLLM

Triton

Job description

CoreWeave is seeking a Solution Specialist for AI Runtime Services in New York, NY. This role focuses on launching new runtime services like Inference and Sandboxes to new customers. You will drive technical and commercial strategies and engage with major buyers to operationalize AI with low-latency and high-throughput solutions.

Candidates should have over 10 years of relevant experience, along with in-depth knowledge of AI processing frameworks and deployment strategies.