Senior Inference Systems Engineer - ML & GPU Ops

CoreWeave; Bellevue (WA); Hybrid; USD 165,000 - 242,000; Full time

Benefits offered by this job

Medical insurance

Discretionary bonus

Tuition reimbursement

401(k) with employer match

Flexible PTO

Job summary

CoreWeave in Bellevue, WA is seeking an experienced engineer to lead design reviews and optimize distributed systems. The role requires 5-8 years in cloud services, strong skills in Python or Go, and hands-on experience with Kubernetes. Key responsibilities include defining SLIs/SLOs and mentoring junior engineers. The compensation includes a base salary range of $165,000 to $242,000, along with a discretionary bonus and comprehensive benefits including health insurance and flexible PTO.

Qualifications

• 5-8 years industry experience building distributed systems or cloud services.
• Strong coding skills in Python or Go; familiarity with C++ is a plus.
• Experience with Kubernetes at production scale, CI/CD, and observability.

Responsibilities

• Lead design reviews and drive architecture within the team.
• Define and own SLIs/SLOs; ensure improvements after incidents.
• Optimize end-to-end ML system performance.

Skills

Distributed systems

Python

Go

Kubernetes

CUDA

Performance optimization

Incident response

Metrics-driven work

Tools

Prometheus

Grafana

OpenTelemetry

Job description

CoreWeave in Bellevue, WA is seeking an experienced engineer to lead design reviews and optimize distributed systems. The role requires 5-8 years in cloud services, strong skills in Python or Go, and hands-on experience with Kubernetes. Key responsibilities include defining SLIs/SLOs and mentoring junior engineers. The compensation includes a base salary range of $165,000 to $242,000, along with a discretionary bonus and comprehensive benefits including health insurance and flexible PTO.