Inference AI/ML Engineer - GPU Cloud Platform

CoreWeave; Bellevue (WA); On-site; USD 92,000 - 135,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

Company-paid Life Insurance

401(k) with generous employer match

Flexible PTO

Catered lunch in office

Job summary

CoreWeave in Bellevue, WA is looking for an IC1 to join the Inference team to ship features that improve latency, reliability, and cost for model serving on our GPU platform. You’ll implement well-scoped changes and grow quickly with mentorship.

You’ll work with Python/Go/C++, write tests, contribute design docs, add metrics, and participate in on-call rotations. A strong foundation in CS, data structures, and Linux is expected, with experience in containers and Kubernetes a plus.

Qualifications

• BS/MS in CS, EE, or related field or equivalent practical experience.
• Strong foundations in data structures, algorithms, and networked services.
• Experience with Python or Go; C++ is a plus; Linux fundamentals; Git/CI basics.
• Exposure to containers and Kubernetes; curiosity about GPU inference concepts.

Responsibilities

• Implement well-scoped features and fixes in Python/Go/C++ for model-serving services.
• Write tests, code comments, and short design docs; participate in code reviews.
• Add basic metrics and dashboards; assist with alarms and runbooks.
• Follow on-call runbooks and learn incident response in a guided rotation.
• Contribute to performance experiments (e.g., micro-batching, concurrency, caching).

Skills

Python

Go

C++

Linux basics

Git/CI

Kubernetes

Data structures & algorithms

Education

BS/MS in CS, EE, or related field

Tools

Triton

vLLM

TensorRT-LLM

Ray Serve

Job description

CoreWeave in Bellevue, WA is looking for an IC1 to join the Inference team to ship features that improve latency, reliability, and cost for model serving on our GPU platform. You’ll implement well-scoped changes and grow quickly with mentorship.

You’ll work with Python/Go/C++, write tests, contribute design docs, add metrics, and participate in on-call rotations. A strong foundation in CS, data structures, and Linux is expected, with experience in containers and Kubernetes a plus.