Remote Senior GPU SRE - Multi-Region AI Clusters

REALM; Brussel; Remote; EUR 125,000 - 179,000; Full time

Job summary

REALM is seeking a Senior Site Reliability Engineer to own GPU infrastructure for training and inference workloads across multiple providers and regions. You will diagnose issues from the network fabric through the kernel to the ML framework and drive reliability improvements.

You’ll work remotely with international teams, maintain InfiniBand/NVLink health, and build automation for provisioning, monitoring, and incident response. Strong Linux, CUDA, and Kubernetes skills are essential.

Qualifications

• Experience running large GPU clusters in production.
• Production experience with InfiniBand, RoCE or NVLink.
• Understanding of training job behavior at the systems level (NCCL, CUDA, PyTorch distributed).
• Strong Linux, kernel tuning and NVIDIA driver/CUDA management.
• Kubernetes with GPU workloads or Slurm/HPC schedulers.
• Python/Go/Bash tooling; Terraform/Helm/Ansible.

Responsibilities

• Designing and running multi-provider, multi-region GPU clusters for large training jobs.
• Acting as the technical contact for customers, from onboarding through to live troubleshooting and tuning.
• SLOs, capacity planning and reliability across a mixed GPU fleet.
• Keeping InfiniBand, RoCE and NVLink fabrics healthy.
• Monitoring that shows GPU utilisation, interconnect throughput and hardware health.
• Automation for provisioning, health checks, self-healing and driver updates.
• Leading incidents where the root cause could sit in hardware, network, orchestration or the ML stack.

Skills

GPU cluster management

Linux kernel tuning

SRE incident leadership

Python/Go/Bash scripting

Tools

InfiniBand

RoCE

NVLink

CUDA

NCCL

nvidia-smi

DCGM

Terraform

Helm

Ansible

Kubernetes

Slurm

Job description

REALM is seeking a Senior Site Reliability Engineer to own GPU infrastructure for training and inference workloads across multiple providers and regions. You will diagnose issues from the network fabric through the kernel to the ML framework and drive reliability improvements.

You’ll work remotely with international teams, maintain InfiniBand/NVLink health, and build automation for provisioning, monitoring, and incident response. Strong Linux, CUDA, and Kubernetes skills are essential.