Senior Inference Platform Engineer

Coreweave; Greater London; Presencial; GBP 95 000 - 140 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Family‑level Medical Insurance

Family‑level Dental Insurance

Generous Pension Contribution

Life Assurance at 4x Salary

Critical Illness Cover

Employee Assistance Programme

Tuition Reimbursement

Work culture focused on innovative Dis

Resumo da oferta

CoreWeave in the United Kingdom is seeking a Senior Software Engineer, Inference, to own architecture and drive improvements across services. You'll collaborate with product, orchestration, and hardware teams to evolve a Kubernetes-native inference platform while delivering on strict P99 SLAs at scale.

You will lead design reviews, decompose multi-service work, and own infrastructure areas such as routing, adaptive scheduling, and GPU resource isolation, implementing optimizations like

Qualificações

• Bachelor’s or Master’s degree in Computer Science or a related technical field (or equivalent practical experience).
• 3+ years of professional industry experience building distributed systems or high‑performance cloud services.
• Strong software development skills in Python or Go, alongside deep familiarity with networked systems and performance optimisation.
• Hands‑on experience with Kubernetes at production scale, including automated CI/CD and modern observability stacks (e.g., Prometheus, Grafana, OpenTelemetry).
• Practical, working knowledge of inference internals: batching strategies, caching, mixed precision (BF16/FP8), and streaming token delivery.
• Proven track record of improving tail latency (P95/P99) and service reliability through metrics‑driven engineering work.
• Experience defining and owning SLIs/SLOs, managing capacity planning, autoscaling policies, and driving post‑incident remediation.

Responsabilidades

• Leading technical designs, raising engineering standards, and delivering measurable improvements across multiple services.
• Partner with product, orchestration, and hardware teams to evolve Kubernetes‑native inference platform while meeting strict P99 SLAs at scale.
• Lead design reviews, decompose multi‑service work into clear milestones, and own critical infrastructure areas such as request routing, adaptive scheduling, cost‑per‑token analytics, and GPU resource isolation.
• Implement advanced optimizations—including micro‑batch schedulers, speculative decoding, and KV‑cache reuse—while refining capacity planning, autoscaling policies, and mentoring engineers across the team.

Conhecimentos

Python

Go

Kubernetes

CI/CD

Observability

Performance optimization

Formação académica

Bachelor's degree

Ferramentas

Prometheus

Grafana

OpenTelemetry

CUDA

NCCL/SHARP

RDMA/NUMA

Descrição da oferta de emprego

CoreWeave in the United Kingdom is seeking a Senior Software Engineer, Inference, to own architecture and drive improvements across services. You'll collaborate with product, orchestration, and hardware teams to evolve a Kubernetes-native inference platform while delivering on strict P99 SLAs at scale.

You will lead design reviews, decompose multi-service work, and own infrastructure areas such as routing, adaptive scheduling, and GPU resource isolation, implementing optimizations like