Senior Machine Learning Engineer

Dex

Greater London

On-site

GBP 120,000 - 180,000

Full time

11 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Dex is seeking a highly experienced ML systems engineer to architect and operate real-time multimodal model serving at scale in London. You will own GPU utilisation, latency, and throughput optimisations across PyTorch, CUDA, Kubernetes on AWS/GCP, delivering robust production-ready platforms.

You will build scalable offline and online inference pipelines, transform research prototypes into maintainable platform features, and drive cost-efficient deployments.

Qualifications

  • 5+ years of software engineering experience with deep expertise building and running production ML systems or model-backed distributed infrastructure at scale.
  • Hands-on mastery of deep learning model serving and inference optimisation, including GPU utilisation, dynamic batching, and latency-throughput-cost trade-offs.
  • Proven track record designing and operating scalable distributed systems on Kubernetes and cloud infrastructure (GCP/AWS) using Python and PyTorch.
  • Based in or able to relocate to London, working on-site in the office at least four days a week.

Responsibilities

  • Architect and run low-latency serving infrastructure for heavy vision and multimodal models, delivering real-time predictions directly into high-throughput annotation workflows.
  • Build scalable offline inference pipelines processing millions of hours of egocentric video for robotics customers, balancing GPU cluster costs, throughput, and fault tolerance.
  • Productionise agentic quality-control and active learning workflows, transforming research prototypes into resilient, self-healing platform features.
  • Profile and optimise end-to-end model serving performance across PyTorch, CUDA, and Kubernetes environments on AWS and GCP.

Skills

Software engineering
Deep learning serving
GPU optimization
Kubernetes
Python
PyTorch
Cloud infrastructure
Model deployment

Tools

PyTorch
CUDA
Kubernetes
AWS
GCP

Job description

This role is with one of Dex's trusted partner companies.

What You Bring
  • 5+ years of software engineering experience with deep expertise building and running production ML systems or model-backed distributed infrastructure at scale.
  • Hands-on mastery of deep learning model serving and inference optimisation, including GPU utilisation, dynamic batching, and latency-throughput-cost trade-offs.
  • Proven track record designing and operating scalable distributed systems on Kubernetes and cloud infrastructure (GCP/AWS) using Python and PyTorch.
  • Demonstrated ownership taking experimental research prototypes and re-architecting them into dependable, maintainable platform features.
  • Based in or able to relocate to London, working on-site in the office at least four days a week.

The role This company builds the multimodal data and evaluation platform powering model development for hundreds of leading AI teams, from autonomous vehicles to frontier robotics. Backed by top-tier global venture firms with significant growth funding, they provide the essential infrastructure that bridges raw visual and sensory data with production AI performance. You will join the in-house ML team sitting firmly on the engineering side, owning the architecture, deployment, and reliability of vision and multimodal models in production. This is not a role for prompt wrapping or tweaking hyperparameters in notebooks. It is a systems-first software engineering seat where you will solve hard GPU utilisation, latency, and throughput bottlenecks to deliver real-time model inference and closed‑loop data feedback at massive scale.

The work Architect and run low‑latency serving infrastructure for heavy vision and multimodal models, delivering real-time interactive predictions directly into high‑throughput annotation workflows. Build scalable offline inference pipelines processing millions of hours of egocentric video for robotics customers, balancing GPU cluster costs, throughput, and fault tolerance. Productionise agentic quality‑control and active learning workflows, transforming fragile research prototypes into resilient, self‑healing platform features. Design dynamic model integration layers that gracefully handle rapid, customer‑defined ontology shifts without requiring bespoke one‑off code. Profile and optimise end-to-end model serving performance across PyTorch, CUDA, and Kubernetes environments on AWS and GCP.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior ML Engineer: Real-Time Vision at Scale (London)
Senior ML Engineer: Real-Time Vision at Scale (London)

Dex • Greater London

On-site
GBP 120,000 - 180,000
Senior Machine Learning Engineer
Senior Machine Learning Engineer

Xcede • Greater London

Hybrid
GBP 95,000 - 130,000
Machine Learning Engineer
Machine Learning Engineer

Dex • Greater London

On-site
GBP 90,000 - 150,000
ML Systems Engineer
ML Systems Engineer

Roc Search Inc. • Greater London

Hybrid
GBP 100,000 - 110,000
Staff Machine Learning Engineer
Staff Machine Learning Engineer

Actcareers • United Kingdom

On-site
GBP 110,000 - 170,000
ML Engineer - Simulation & Robotics (up to £100k)
ML Engineer - Simulation & Robotics (up to £100k)

Dex • Cambridge

On-site
GBP 70,000 - 100,000
DevOps Engineer
DevOps Engineer

Dex • Greater London

On-site
GBP 90,000 - 150,000
Staff Machine Learning Engineer (£220,000 | RecSys | Python)
Staff Machine Learning Engineer (£220,000 | RecSys | Python)

Dex • Greater London

On-site
GBP 198,000 - 242,000
Competitive compensation
Performance bonus
Strong influence over technical direction
Machine Learning Engineer
Machine Learning Engineer

trg. • Greater London

Hybrid
GBP 54,000 - 90,000
ML Engineer
ML Engineer

Thisisglobal • Greater London

On-site
GBP 70,000 - 120,000