Remote HPC GPU Infrastructure Engineer

ElevenLabs; Greater London; Hybrid; GBP 120,000 - 180,000; Full time

Benefits offered by this job

Remote-friendly

Global team

Office options: London, New York, San 

Francis

Job summary

ElevenLabs is hiring a remote-first Infrastructure Engineer to own our GPU compute infrastructure, from provisioning to maintenance, across bare-metal and rented capacity. You’ll optimize training throughput and reliability, writing automation in Python/Bash and managing the NVIDIA stack.

You’ll collaborate with a lean, global team, with opportunities to work from our offices or remotely. We value builders who own problems end to end and ship high-quality infrastructure for research.

Qualifications

• Have run large-scale Linux server or GPU environments in production and enjoy both building and operating
• Know the NVIDIA stack well — drivers, CUDA, NCCL, DCGM — or have deep systems experience and learn hardware stacks fast
• Are comfortable with bare-metal environments, server hardware, and high-speed networking
• Write solid automation in Python and/or Bash, with IaC tools like Ansible or Terraform
• Are happy digging into noisy data (metrics, logs, PromQL) to find what's actually wrong
• Like owning real scope end to end and being the person others rely on
• Don't consider any task above or beneath you — datacenter trips included

Responsibilities

• Operate and improve our GPU fleet end to end: provisioning, scheduling, monitoring, upgrades, capacity planning
• Build automation that keeps the fleet healthy without human intervention — node health checks, automated draining and remediation, burn-in pipelines for new capacity
• Own the stack beneath the training code: OS images, NVIDIA drivers, CUDA, container runtimes, NCCL, high-speed networking (InfiniBand/RoCE)
• Run and tune job scheduling (Slurm or similar) so researchers get compute fairly and fast
• Build and maintain high-performance storage for datasets and checkpoints
• Hunt down performance problems: stragglers, degraded links, thermal issues, flaky GPUs — and fix the class of problem, not just the instance
• Evaluate rented GPU capacity: benchmark it, validate it, hold providers to their SLAs
• Hands-on hardware work when it's needed: racking, cabling, diagnostics, coordinating with datacenter staff and vendors
• Keep clusters secure by default: access control, network isolation, secrets

Skills

Linux server admin

GPU compute environments

Automation scripting

End-to-end ownership

Performance troubleshooting

Security best practices

Tools

Ansible

Terraform

Slurm

CUDA drivers

NCCL

DCGM

InfiniBand/RoCE networking

Python

Bash

PromQL

Job description

ElevenLabs is hiring a remote-first Infrastructure Engineer to own our GPU compute infrastructure, from provisioning to maintenance, across bare-metal and rented capacity. You’ll optimize training throughput and reliability, writing automation in Python/Bash and managing the NVIDIA stack.

You’ll collaborate with a lean, global team, with opportunities to work from our offices or remotely. We value builders who own problems end to end and ship high-quality infrastructure for research.