GenAI Infra Engineer: Real-Time GPU Serving & Open-Weights

deliveroo; Greater London; On-site; GBP 90,000 - 150,000; Full time

Job summary

Deliveroo's GenAI Platform team is hiring a Software Engineer to build production infrastructure for open-weights model serving, inference pipelines, and fine-tuning. You will work across backend services, GPU autoscaling, and observability to deliver scalable, cost-aware AI platforms for internal and partner teams.

Ideal candidates have 3+ years in software engineering, strong Python and distributed systems skills, and hands-on experience with ML infrastructure at scale and production-grade

Qualifications

• BSc, MSc or PhD in Computer Science or equivalent.
• 3+ years of industry experience in software engineering.
• Strong backend fundamentals in Python and distributed systems.
• Experience building production services, APIs, data pipelines, or ML infrastructure at scale.
• Experience operating systems in production, including observability and performance optimization.
• Hands-on experience with LLM inference and/or fine-tuning of open-weight models in production.
• Ability to work across ambiguous, fast-moving technical areas and turn customer use cases into reusable platform capabilities.
• Proficiency in AI coding tools in the full software lifecycle.

Responsibilities

• Build production infrastructure for open-weights model serving and fine-tuning.
• Work across model serving, inference engines, and training pipelines.
• Design scalable systems for model serving, batch inference, and GPU autoscaling.
• Improve cost efficiency and observability for AI platforms.
• Collaborate with ML engineers, product engineers, data scientists, and platform teams.

Skills

Python

Distributed systems

APIs

ML infrastructure

LLM inference

Kubernetes

Cloud (AWS/GCP)

Observability

GPU utilization

SFT/LoRA

Education

CS degree

Tools

Docker

Git

Linux

TensorRT

ML frameworks

Job description

Deliveroo's GenAI Platform team is hiring a Software Engineer to build production infrastructure for open-weights model serving, inference pipelines, and fine-tuning. You will work across backend services, GPU autoscaling, and observability to deliver scalable, cost-aware AI platforms for internal and partner teams.

Ideal candidates have 3+ years in software engineering, strong Python and distributed systems skills, and hands-on experience with ML infrastructure at scale and production-grade