Senior AI Inference Platform Engineer

Coreweave

Sunnyvale, Bellevue (CA, WA)

On-site

USD 182,000 - 242,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical, dental, and vision insurance
401(k) with company match
Flexible PTO
Equity awards

Job summary

CoreWeave, The Essential Cloud for AI, in Sunnyvale, CA, is seeking senior engineers to own design reviews, drive architecture, and improve latency, throughput, and reliability across services. You will partner with product, orchestration, and hardware teams to evolve our Kubernetes-native inference platform and meet strict P99 SLAs at scale.

The ideal candidate has 3–8 years building distributed systems, strong Python or Go skills (C++ a plus), and hands‑on experience with Kubernetes, CI/CD,

Qualifications

  • 3–8 years in distributed systems or cloud services (IC3/IC4).
  • Strong coding in Python or Go; C++ a plus.
  • Hands-on Kubernetes at production scale, CI/CD, and observability stacks.
  • Knowledge of inference internals: batching, caching, mixed precision.
  • Proven track record improving tail latency and reliability.
  • Bachelor's or Master's in Computer Science or related field (or equivalent).

Responsibilities

  • Lead design reviews and drive architecture within the team; decompose multi-service work into milestones.
  • Define and own SLIs/SLOs; ensure post-incident actions land and reliability improves.
  • Implement advanced optimizations (e.g., micro-batch schedulers, speculative decoding, KV-cache reuse) and quantify impact.
  • Strengthen incident posture: capacity planning, autoscaling policy, graceful degradation, rollback/traffic-shift strategies.
  • Mentor IC1/IC2 engineers; review cross-team designs and elevate coding/testing standards.
  • For IC4: own an area spanning multiple services and teams (e.g., request routing & adaptive scheduling, cost-per-token analytics, GPU resource isolation).

Skills

Python
Go
Distributed systems
Performance optimization

Education

Bachelor's or Master's in Computer Science or related field

Tools

Kubernetes
CI/CD
Prometheus
Grafana
OpenTelemetry

Job description

CoreWeave, The Essential Cloud for AI, in Sunnyvale, CA, is seeking senior engineers to own design reviews, drive architecture, and improve latency, throughput, and reliability across services. You will partner with product, orchestration, and hardware teams to evolve our Kubernetes-native inference platform and meet strict P99 SLAs at scale.

The ideal candidate has 3–8 years building distributed systems, strong Python or Go skills (C++ a plus), and hands‑on experience with Kubernetes, CI/CD,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

Coreweave • Bellevue (WA)

On-site
USD 152,000 - 204,000
Medical, dental, vision insurance (100
401(k) with employer match
Flexible PTO
+5
Senior AI Inference Platform Engineer
Senior AI Inference Platform Engineer

Fdetimes • Sunnyvale (CA)

On-site
USD 152,000 - 204,000
Medical, dental, and vision insurance
Company-paid Life Insurance
401(k) with generous employer match
+2
Senior Software Engineer - AI Inference Platform
Senior Software Engineer - AI Inference Platform

Coreweave • Sunnyvale (CA)

On-site
USD 152,000 - 204,000
Medical, dental, and vision insurance
401(k) with employer match
Flexible PTO
+6
Senior AI Infra Engineer — Kubernetes & Scale
Senior AI Infra Engineer — Kubernetes & Scale

Coreweave • Washington

On-site
USD 182,000 - 242,000
Medical, dental, and vision insurance
401(k) with employer match
Paid Parental Leave
+2
Senior AI Cloud Platform Architect
Senior AI Cloud Platform Architect

BranchFactor • Bellevue (WA)

On-site
USD 182,000 - 242,000
Medical, dental, and vision insurance
401(k) with match
Paid Parental Leave
+2
Senior AI Platform Engineer (Go/K8s, Scale)
Senior AI Platform Engineer (Go/K8s, Scale)

Fdetimes • Sunnyvale (CA)

On-site
USD 182,000 - 242,000
Medical, dental, and vision insurance
Equity awards
401(k) with match
+4
Staff AI Inference Systems Engineer
Staff AI Inference Systems Engineer

Coreweave • Sunnyvale (CA)

On-site
USD 188,000 - 275,000
Medical, dental, and vision insurance
Company-paid Life Insurance
Voluntary supplemental life insurance
+3
Senior AI Infra Engineer: Kubernetes & Distributed Systems
Senior AI Infra Engineer: Kubernetes & Distributed Systems

Coreweave • Sunnyvale (CA)

On-site
USD 182,000 - 242,000
Medical, dental, and vision insurance
401(k) with generous employer match
Tuition Reimbursement
+2
Senior Infra Architect for AI Cloud Platform
Senior Infra Architect for AI Cloud Platform

Coreweave • Chicago (IL)

On-site
USD 206,000 - 275,000
Medical, dental, and vision insurance
401(k) with generous employer match
Flexible PTO
+4
Senior AI Inference Performance Engineer
Senior AI Inference Performance Engineer

FDE Times • Sunnyvale (CA)

On-site
USD 139,000 - 204,000
Medical insurance
401(k)
Paid time off
+1