Senior HPC Platform Engineer (HPC / GPU Infrastructure) (m/f/d)

Northern Data Services (UK) Limited

Greater London

Híbrido

GBP 90 000 - 130 000

Tempo integral

Há 2 dias
Torna-te num dos primeiros candidatos

Recebe uma resposta deste empregador

O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.

Ultrapassa os filtros ATS

Vantagens oferecidas por esta oferta de emprego

Home office flexibility
Wellbeing initiatives

Resumo da oferta

Northern Data Services (UK) Limited is hiring a Senior Platform Engineer to own a bare-metal GPU platform for AI workloads. You will manage Linux hosts, GPUs, DPUs and InfiniBand across multiple European datacentres, with strong emphasis on virtualization, orchestration, and automation.

The role requires hands-on Linux expertise in HPC environments, experience with BlueField DPUs, InfiniBand networks, and Kubernetes-based deployment.

Qualificações

  • Deep knowledge of Linux OS, kernel modules, drivers, hugepages, NUMA, IOMMU/VFIO.

Responsabilidades

  • Build, tune and maintain Linux bare-metal GPU hosts for HPC/AI workloads.
  • Deploy, configure and operate BlueField DPUs in DPU mode.
  • Operate InfiniBand fabrics with OpenSM and UFM; manage NCCL/RDMA traffic.
  • Deliver GPU virtualization via PCIe passthrough and SR-IOV; integrate GPU VMs into Kubernetes.
  • Manage hardware generations and topology across data centres.
  • Run IPv6-first host networking; support storage networks (NVMe-oF, RoCE, NFS).
  • Automate provisioning with PXE, preseed, cloud-init, Redfish/IPMI; extend IaC.
  • Write Bash and Python tooling for deployment, health checks, fleet operations.
  • Lead incident response across European datacentres with root-cause analysis.
  • Collaborate with networking/storage/Kubernetes teams for future hardware.

Conhecimentos

Linux HPC
BlueField DPUs
InfiniBand OpenSM
Kubernetes
GPU Virtualization
SR-IOV
PXE/cloud-init
Ansible IaC
Bash scripting
Python scripting
Redfish/IPMI
KVM/QEMU

Ferramentas

Docker
KVM/QEMU
libvirt
Nautobot
OpenBao
Defguard
PXE
preseed
cloud-init
Ansible
Redfish

Descrição da oferta de emprego

Job Description

We are hiring a Senior Platform Engineer to build, run and harden the bare-metal GPU platform behind our AI cloud. This is a hands-on Linux systems role at the intersection of HPC, GPU virtualisation and high-performance fabrics: you will own the servers, the OS, the GPUs, the DPUs and the InfiniBand fabric they run on. We are a European Neocloud operating a large NVIDIA GPU estate (H100, H200 and B300) across multiple datacentres in Europe. Our customers run large-scale AI training and inference workloads, on both physical and virtualised GPU clusters, and they depend on our platform being fast, stable and predictable.

The platform you will own: Compute: Linux bare-metal GPU servers with NVIDIA H100, H200 and B300 GPUs. Virtualisation: KVM/QEMU via libvirt on selected hosts; KubeVirt for VM workloads on Kubernetes; GPU passthrough and SR-IOV Virtual Functions. DPUs: NVIDIA BlueField-2 and BlueField-3, operated in DPU mode. GPU Fabric: InfiniBand on ConnectX-7 and ConnectX-8 adapters, managed with OpenSM and NVIDIA UFM. Ethernet & Storage: Multi-tier spine-leaf Ethernet carrying block and object (blob) storage traffic; IPv6-first addressing. Storage: NVMe-oF, RoCE and NFS; VAST Data and Pure Storage platforms. Operating Systems: Debian / Ubuntu; immutable Kubernetes distributions (Flatcar, Fedora CoreOS). Orchestration: Kubernetes with Operators, CNIs and CSIs; Docker / containers. Tooling: Ansible (IaC), Nautobot, OpenBao, Defguard, PXE / preseed / cloud-init, Redfish / IPMI. This is a platform engineering role, not a network engineering role. Networking, fabric and storage knowledge matter because they are part of the server platform you operate end to end.

Responsibilities
  • Build, tune and maintain Linux bare-metal GPU hosts for HPC and AI workloads, from BIOS/BMC through kernel, drivers and firmware.
  • Deploy, configure and operate BlueField-2/3 DPUs in DPU mode, including BFB images, DOCA services, OVS offload and network/storage offload on the Arm cores.
  • Operate and troubleshoot InfiniBand fabrics with OpenSM and UFM: subnet management, partitions (PKeys), routing, health monitoring, and performance analysis of NCCL and RDMA traffic.
  • Deliver GPU virtualisation: PCIe passthrough, SR-IOV Virtual Functions on GPUs and ConnectX adapters, and integration of GPU VMs into Kubernetes via KubeVirt or libvirt/QEMU hypervisors.
  • Build and support both physical and virtual GPU clusters interconnected over InfiniBand, down to NUMA, PCIe topology, GPUDirect RDMA and IOMMU level.
  • Run IPv6-first host networking and support storage networks carrying NVMe-oF, RoCE, NFS, block and object traffic across the spine-leaf fabric.
  • Automate provisioning and lifecycle with PXE, preseed, cloud-init, Redfish/IPMI and Ansible; review and extend our existing IaC code base.
  • Write production-quality Bash and Python tooling for deployment, validation, health checks and fleet operations.
  • Lead incident response for platform issues across multiple European datacentres, perform root-cause analysis, and drive permanent fixes.
  • Work with networking, storage, Kubernetes and customer-facing teams to plan hardware generations (e.g. B300, ConnectX-8, BlueField-3) into production.
Essential Skills (in priority order)
  • Linux in an HPC configuration: Deep knowledge of the Linux OS and kernel: modules, drivers, sysctl/boot parameters, hugepages, NUMA, CPU pinning, IOMMU/VFIO, PCIe topology. Debian/Ubuntu in production; comfortable debugging at kernel level (dmesg, perf, ftrace, crash analysis). Complete understanding of NVIDIA GPUs and GPU concepts: drivers, CUDA, Fabric Manager, NVLink/NVSwitch, MIG, DCGM, GPUDirect RDMA. GPU virtualisation: passthrough, SR-IOV Virtual Functions, vGPU concepts, and VM integration with KVM/QEMU/libvirt or Kubernetes with the KubeVirt operator.
  • NVIDIA BlueField in DPU mode (must have): Extensive hands-on experience with BlueField-2 and/or BlueField-3: provisioning, BFB images, firmware, DOCA, OVS/ASAP2 offload, and host-to-DPU networking. ConnectX-7 / ConnectX-8 configuration, firmware management (mlxconfig, mlxfwmanager) and SR-IOV.
  • InfiniBand with OpenSM and UFM (must have): Operating IB fabrics with both OpenSM and UFM: subnet managers, partitions, routing engines, fabric diagnostics (ibdiagnet, perfquery, ibnetdiscover). Low-level RDMA concepts (verbs, QPs, GIDs, LIDs) and validating physical and virtual GPU clusters over IB (perftest, NCCL tests).
  • Networking, with an emphasis on IPv6: Strong TCP/IP fundamentals for IPv6 and IPv4: addressing, SLAAC/DHCPv6, neighbour discovery, routing. Working knowledge of DHCP, DNS, NTP and BGP as they apply to hosts in a spine-leaf datacentre fabric.
  • Storage networks: Block and object (blob) storage concepts over Ethernet: NVMe-oF (TCP/RDMA), RoCE, NFS, multipathing and performance tuning. Understanding how storage traffic behaves across a multi-tier spine-leaf network (QoS, PFC/ECN for RoCE, MTU).
Experience

Bash and Python: excellent Bash; excellent Python for automation and tooling (strong scripting and maintainable code, not necessarily software-developer level).

  • Automation: working knowledge of Ansible to review and enhance an existing IaC code base.
  • Server management and deployment: BMC, Redfish, IPMI; PXE, preseed, cloud-init.
  • Containers: Docker/containerd and Kubernetes, including Operators, CNIs and CSIs.
  • Incident handling: proven ability to lead incidents on production infrastructure, under pressure, through to root cause.
Desirable Skills

Hands-on experience with VAST Data and/or Pure Storage. Immutable, Kubernetes-focused OS distributions such as Flatcar Container Linux or Fedora CoreOS. Operational experience with Nautobot, OpenBao (or HashiCorp Vault) and Defguard. General knowledge of HPC and AI concepts and tooling: Slurm, MPI, NCCL, distributed training and inference frameworks. NVIDIA GPU Operator and Network Operator on Kubernetes. Experience in a cloud provider, Neocloud or large HPC centre operating GPUs at scale across multiple sites.

About you

Typically 7+ years in Linux systems or infrastructure engineering, with recent hands-on time on GPU or HPC platforms. Calm and methodical during incidents; you dig to root cause rather than stopping at the workaround. You automate by default and leave behind documentation and tooling others can use. Clear communicator in English, comfortable working across teams and datacentres in different countries.

What We Offer

With us, you will work towards the future of HPC: From new, sustainable building methods for data centers to cooling concepts to software solutions for accelerated compute. Your approaches count: In official exchange formats or spontaneously at the coffee machine. At Northern Data, it's the best idea that counts - not the hierarchy. We're looking forward to getting your inputs! You make the difference in the company: Unlike in established corporations, at Northern Data you will really help shape things. From implementing new departments, to optimizing processes and culture. Best-in-class partners: The best work with Northern Data. This means a knowledge and time advantage from which your career and our customers benefit equally. Green by heart: Sustainability is at the core of Northern Data. With us, you actively work on the carbon neutrality of datacenters worldwide. Beginning with our infrastructure and continuing with the solutions for our clients, we work towards a green future.

Home Office Facts

Work with our international and virtual team flexible from home. And of course, your hardware wishes will be fulfilled to make your ideas for next level HPC come true.

Your Wellness Matters

At Northern Data we have regular wellbeing initiatives that are designed to promote wellness, diversity, inclusion, and much more, ensuring a supportive and enriching environment for our global team.

Company Overview

Northern Data Group is a leading provider of full-stack AI and High-Performance Computing (HPC) solutions, leveraging a network of high-density, liquid-cooled, GPU-based technology to enable the world’s most innovative companies. Together with our partners, we are passionate about the potential of HPC to drive both technological and societal transformation.

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Operations Engineering Manager (m/f/d)
Operations Engineering Manager (m/f/d)

Northern Data Group • Greater London

Híbrido
GBP 90 000 - 130 000
Purchasing & Procurement Specialist (m/f/d)
Purchasing & Procurement Specialist (m/f/d)

Northern Data Services (UK) Limited • Greater London

Híbrido
GBP 38 000 - 52 000
Home office flexibility
Wellbeing initiatives
Global team collaboration
Senior HPC Engineer
Senior HPC Engineer

NexGen Cloud • Grã-Bretanha

Teletrabalho
AUD 136 000 - 214 000
Competitive salary
Annual discretionary bonus
25 days holiday
+8
Senior HPC Engineer
Senior HPC Engineer

NexGen Cloud • Greater London

Teletrabalho
GBP 70 000 - 100 000
Competitive salary and bonus scheme
Employee wellbeing benefits
25 days holiday
+3
Senior HPC Platform Engineer (HPC / GPU Infrastructure) (m/f/d)
Senior HPC Platform Engineer (HPC / GPU Infrastructure) (m/f/d)

Quake AI • Greater London

Presencial
GBP 110 000 - 170 000
UK&I Office Manager & Executive Assistant (m/f/d)
UK&I Office Manager & Executive Assistant (m/f/d)

Northern Data Group • Greater London

Presencial
GBP 35 000 - 50 000
Wellbeing initiatives
Flexible work from home
Sustainability-oriented projects
Senior HPC Engineer
Senior HPC Engineer

NexGen Cloud Ltd. • Grã-Bretanha

Teletrabalho
GBP 90 000 - 130 000
Salary & bonus
Private medical insurance
Pension scheme
+6
HPC Engineer
HPC Engineer

NexGen Cloud • Greater London

Híbrido
GBP 85 000 - 110 000
Salary + Bonus
Private Medical Insurance
Enhanced Pension Scheme
+5
Senior Solutions Engineer
Senior Solutions Engineer

Hamilton Barnes ? • Grã-Bretanha

Teletrabalho
GBP 120 000 - 180 000
Technical Architect - AI Infrastructure Deployment
Technical Architect - AI Infrastructure Deployment

NexGen Cloud Ltd. • Greater London

Híbrido
GBP 90 000 - 130 000
Competitive salary
Private Medical Insurance
25 days holiday
+2