MLOps Engineer

Dex; Greater London; On-site; GBP 85,000 - 140,000; Full time

Job summary

This London-based infrastructure company is seeking an experienced MLOps engineer to own deployment, observability, and reliability of LLM services on high-throughput Kubernetes infrastructure. You will work at the intersection of distributed systems, GPU scheduling, and agent execution logic to deliver scalable AI platforms for enterprise clients.

You will define deployment patterns, orchestration strategies, and cost optimizations while maintaining traceability and resilience under real-world

Qualifications

• 3+ years in MLOps/LLMOps or AI platform engineering with production Kubernetes workloads.
• Strong Python engineering with Infrastructure as Code and modern CI/CD automation.
• Hands-on observability and LLM tracing using OpenTelemetry, Prometheus, Grafana, LangSmith, Langfuse, or Arize.
• Experience with agentic architectures, including state persistence and multi-step agent failure handling.

Responsibilities

• Architect and automate zero-downtime deployment pipelines for LLM services and autonomous agent workflows on Kubernetes, using canary and blue/green rollouts.
• Build end-to-end evaluation and observability framework to trace non-deterministic agent paths, monitor hallucination rates, and detect model drift.
• Own GPU and CPU allocation, cluster autoscaling and compute efficiency to drive down time-to-first-token while controlling infrastructure expenditure.
• Maintain the stability and latency of critical data subsystems, including real-time vector indexing, embedding pipelines, and feature stores.
• Diagnose complex production failure modes that span agent runtime logic, orchestration frameworks, and underlying cloud infrastructure.

Skills

MLOps

LLMOps

Kubernetes

Python

CI/CD

Tools

OpenTelemetry

Prometheus

Grafana

LangSmith

Langfuse

Arize

Job description

This role is with one of Dex's trusted partner companies. We work closely with their teams to truly understand their culture, goals, and what they're looking for, so we can match you with the right opportunity and give you context about the role before you commit to a process.

Dex is an AI recruiter agent that helps you run your job search. Tell Dex your stack, seniority, and what you want to build. We will manage your applications and surface other opportunities that are a fit.

The role

Most enterprise AI rollouts rely on public cloud APIs that heavily regulated organisations cannot touch. This London-based infrastructure company builds sovereign runtime environments that allow defence, intelligence, and regulated enterprise teams to deploy frontier and open-weight models entirely inside their own perimeters, including air-gapped clusters. Backed by over $70M from tier-one global investors and led by alumni from top-tier enterprise software and defence engineering, they are tackling the foundational reliability problem of sovereign AI.

As the first dedicated MLOps engineer on the team, you will own how complex LLM services and multi-step agentic applications run, scale, and recover on high-throughput Kubernetes infrastructure. This is not a maintenance seat running standard CI pipelines or an ML research role isolated in notebooks; you will sit directly between distributed systems engineering, GPU scheduling, and agent execution logic. You will define the deployment patterns, cost optimizations, and trace-level observability that keep non-deterministic systems reliable under real enterprise loads.

The work

• Architect and automate zero-downtime deployment pipelines for LLM services and autonomous agent workflows on Kubernetes, using canary and blue/green rollout strategies.
• Build the end-to-end evaluation and observability framework to trace non-deterministic agent execution paths, monitor hallucination rates, and detect model drift.
• Own GPU and CPU allocation, cluster autoscaling, and compute efficiency to drive down time-to-first-token while controlling infrastructure expenditure.
• Maintain the stability and latency of critical data subsystems, including real-time vector indexing, embedding pipelines, and feature stores.
• Diagnose complex production failure modes that span agent runtime logic, orchestration frameworks, and underlying cloud infrastructure.

What You Bring

• 3+ years in MLOps, LLMOps, or AI platform engineering, with proven experience running containerised workloads on Kubernetes at production scale.
• Strong Python engineering ability paired with practical fluency in Infrastructure as Code and modern CI/CD automation.
• Hands-on experience instrumenting observability and LLM tracing across distributed systems using tools like OpenTelemetry, Prometheus, Grafana, LangSmith, Langfuse, or Arize.
• Operational familiarity with agentic architectures, including state persistence, tool execution boundaries, and failure handling across multi-step agent runs.

Why apply through Dex

Genuine LLMOps roles solving deep infrastructure problems - rather than just wrapping hosted API calls - are rare and hard to identify from standard job descriptions. Applying through Dex bypasses generic applicant queues and gets your profile directly in front of the engineering leads running sovereign AI infrastructure. You will be fully briefed on the underlying stack, cluster topology, and interview expectations before entering the process.

As part of the recruitment process at Dex, we process your personal data in accordance with our Privacy Notice for Job Applicants. This notice explains how and why your data is collected and used, and how you can contact us if you have any concerns.