AI Reliability Engineering Manager

Nscale

Greater London

On-site

GBP 110,000 - 170,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Nscale is seeking a seasoned engineering leader to run and grow an AI Reliability Engineering team across EMEA. You will own people, processes, the queue, and escalations, reporting to the AIR Senior Manager for EMEA.

This is a hands-on management role with strong liaising to DC Ops, Network Ops, and Eng teams. You will drive post-incident reviews, define SOPs for your pillar, and push automation to reduce manual work while scaling the GPU fleet toward the 1M target by 2027.

Qualifications

  • 6+ years in infrastructure, operations, or support engineering in production environments.
  • 3+ years managing engineers in an operational function.
  • Experience running a queue against SLAs and owning performance metrics.
  • Clear, concise written and spoken communication.
  • Decisiveness with incomplete information and pragmatism.
  • Strong Linux and networking fundamentals; ITIL/SRE habits; scripting ability.

Responsibilities

  • Lead a team of AI Reliability Engineers (8–10) including 1:1s, objectives, reviews and hiring.
  • Own the queue, prioritize, meet SLAs, manage MTTR and handoffs to Eng and vendors.
  • Run the on-call rota within EMEA and global handover.
  • Be the first management escalation point on P1s and customer escalations; lead post-incident reviews.
  • Own pillar SOPs and drive automation to reduce manual remediation.
  • Manage day-to-day relationships with DC Ops, Network Ops, Eng and fleet tooling teams.
  • Report team metrics weekly and explain changes.

Skills

Linux
Networking
SRE
ITIL
Scripting

Tools

nvidia-smi
DCGM
XID interpretation

Job description

The role

Run the day-to-day operation of an AI Reliability Engineering team of eight to ten engineers across EMEA. You own the people, the queue, the rota, and the escalations. You report to the AIR Senior Manager for EMEA, who holds strategy, budget, and the senior customer relationships, so your time goes on running a world-class operation and growing the engineers in it.

The estate is about 29,000 GPUs today, with a planning target of one million by the end of 2027. You are the first manager hired under the Senior Manager, and as the region grows you take ownership of a full pillar with its own queue and SOPs. It is a hands‑on role: close enough to GPUs, Linux, and high‑performance fabrics to lead an incident and challenge a diagnosis, while leading the team most of the week.

What you’ll be doing
  • Lead a team of eight to ten AI Reliability Engineers: 1:1s, objectives, reviews, probation, development, and hiring
  • Own the queue: prioritization, SLA adherence, MTTR, and backlog, with a named owner on every near-breach ticket and clean handoffs to Engineering and vendors
  • Run the rota and on‑call for the team within the EMEA coverage model and the global follow‑the‑sun handover
  • Be the first management escalation point on P1s and customer escalations, lead post‑incident reviews, and turn repeat incidents into problem records and durable fixes
  • Own the SOPs for your pillar and drive them into Nscale’s automation so that repeatable remediation needs less human time
  • Work the day‑to‑day relationships with DC Operations, Network Operations, Engineering, and the fleet tooling and automation teams
  • Report your team’s numbers weekly and accurately, and explain what moved and why
About you
  • Experience : 6+ years in infrastructure, operations, or support engineering in production environments, including 2+ years around GPU, HPC, or large data center estates
  • Leadership : 3+ years managing engineers in an operational support function, owning reviews, development plans, and performance management through to outcome
  • Operational ownership : you have run a queue against SLAs and are comfortable being accountable for the numbers
  • Communication : clear, specific, and concise, in writing and in person
  • Decisiveness and pragmatism : you make calls with incomplete information, improve process without slowing delivery, and commit once the decision is made
  • Technical foundation : solid production Linux and networking, working knowledge of how GPU fleets fail and get repaired, ITIL and SRE habits, and enough scripting to review an engineer’s work
  • Adaptability : comfortable with out‑of‑hours escalations, on‑call, and travel to data centers and customer sites
Nice to have
  • NVIDIA GPU platform depth: nvidia‑smi, DCGM, and XID interpretation through to RMA (AMD Instinct beneficial)
  • InfiniBand or RoCE diagnostics, NCCL, NVLink and NVSwitch, and Slurm with Pyxis and Enroot
  • Rack‑scale systems such as GB200 and GB300 NVL72
  • BMC and Redfish, MAAS, NetBox, OpenStack, Kubernetes, and Ansible or Terraform
  • High‑performance storage such as VAST, Ceph, or NFS at scale
  • Follow‑the‑sun operations, and ITIL, Linux, networking, Kubernetes, or NVIDIA certifications

_For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice:Here.

Nscale does not accept unsolicited candidate submissions from recruitment agencies.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Reliability Lead — GPU Ops & Incident Mgmt
AI Reliability Lead — GPU Ops & Incident Mgmt

Nscale • Greater London

On-site
GBP 110,000 - 170,000
Senior GPU Infrastructure Engineer - Systems Integrator
Senior GPU Infrastructure Engineer - Systems Integrator

Hamilton Barnes • United Kingdom

Remote
GBP 108,000 - 132,000
4-day work week
Remote-first with flexibility
Uncapped holiday
+1
Principal Solutions Architect
Principal Solutions Architect

Nscale • United Kingdom

On-site
GBP 120,000 - 190,000
Competitive package (base + equity)
Dynamic progression plan
Flexible workplace
+1
HPC Infrastructure Site Reliability Engineer
HPC Infrastructure Site Reliability Engineer

Radiant • Greater London

On-site
GBP 90,000 - 140,000
Principal Software Engineer - Fleet Management
Principal Software Engineer - Fleet Management

Nscale • Greater London

Remote
GBP 90,000 - 120,000
Competitive salary package
Equity options
Flexible working hours
+2
NOC Engineer - AI infrastructure
NOC Engineer - AI infrastructure

Hamilton Barnes • West of England

On-site
GBP 30,000 - 50,000
Site Reliability Engineer - AI Infrastructure
Site Reliability Engineer - AI Infrastructure

Hamilton Barnes • United Kingdom

Remote
GBP 102,000 - 138,000
Fully remote (UK-based)
Benefits package to be confirmed
Design Manager
Design Manager

Nscale • United Kingdom

On-site
GBP 70,000 - 90,000
Centre of Excellence Senior Engineer
Centre of Excellence Senior Engineer

Nscale • Greater London

Hybrid
GBP 90,000 - 130,000
Remote-first collaboration
Office-based work option
Infrastructure Site Reliability Engineer
Infrastructure Site Reliability Engineer

Radiant • Gloucester

On-site
GBP 70,000 - 110,000
25 days annual leave
Cycle to Work Scheme
Gympass subscription