Staff Software Engineer, Inference — Scalable AI Cloud

United States Digital Space LLC; Greater London; On-site; GBP 120,000 - 180,000; Full time

Benefits offered by this job

Family-level Medical Insurance

Dental Insurance

Generous Pension Contribution

Life Assurance

Job summary

CoreWeave is seeking a Staff Software Engineer for the Inference team in London. You will operate as a technical leader across multiple teams, driving architecture, performance, and reliability for a Kubernetes-native inference platform powering GPU workloads.

You will implement advanced inference optimisations, define benchmarking frameworks, and raise engineering rigour and observability across the organisation.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical field.
• 8+ years of experience building large-scale distributed systems or cloud platforms.
• Strong coding proficiency in Go, Python, or C++.
• Deep expertise in Kubernetes at production scale, including orchestration, scheduling, and service design.
• Strong understanding of networked systems, performance optimisation, and distributed system design.
• Hands-on engineering experience with inference systems, including batching/micro-batching strategies, caching, memory optimisation, mixed precision (BF16/FP8), and streaming token delivery.
• Demonstrated ability to systematically improve tail latency (P95/P99) and platform reliability through metrics-driven engineering.
• Proven experience owning system-wide SLIs/SLOs, capacity planning, autoscaling strategies, and mentoring senior and mid-level engineers.

Responsibilities

• Define and lead architecture across multiple teams and services for CoreWeave's Kubernetes-native inference platform.
• Drive performance, reliability, and cost optimization under strict P99 SLAs.
• Implement advanced inference optimisations such as speculative decoding and KV-cache reuse.
• Establish benchmarking frameworks and guide cross-functional alignment across infrastructure boundaries.

Skills

Go

Python

C++

Kubernetes

Distributed systems

Inference systems

Performance optimization

Education

Bachelor's degree in Computer Science/Engineering

Job description

CoreWeave is seeking a Staff Software Engineer for the Inference team in London. You will operate as a technical leader across multiple teams, driving architecture, performance, and reliability for a Kubernetes-native inference platform powering GPU workloads.

You will implement advanced inference optimisations, define benchmarking frameworks, and raise engineering rigour and observability across the organisation.