Head of Data Management

Programming.com; États-Unis; À distance; USD 200 000 - 300 000; Plein temps

Avantages offerts par ce poste

Remote work

Résumé du poste

Programming.com is seeking a Head of Data Center Operations for GPU and AI infrastructure. You will lead end-to-end operations of large-scale GPU clusters, HPC environments, and data center sites, driving reliability, capacity planning, and strategic expansion while working remotely with travel to data centers as needed.

You will manage 24/7 operations teams, collaborate with hardware vendors and engineering, implement automation and monitoring with Slurm, Kubernetes, and Prometheus, and own

Qualifications

• 15+ years in infra engineering or data center ops.
• 7+ years of leadership in production infra.
• Direct experience with NVIDIA GPU clusters is mandatory.

Responsabilités

• Lead end-to-end operations of large-scale GPU clusters and AI infra.
• Manage GPU server deployment, monitoring, maintenance, and lifecycle.
• Ensure high availability and performance for AI training/inference workloads.
• Oversee multi-site data center operations and capacity planning.
• Lead incident management, RCAs, governance, and SLA/SLO performance.
• Build and manage 24/7 ops teams and site leaders.
• Drive automation and fleet monitoring for efficiency and scaling.
• Collaborate with engineering, hardware vendors, and executive leadership.

Connaissances

Infra leadership

Data center ops

GPU HPC

Leadership

Outils

Slurm

Kubernetes

NVIDIA DCGM

Prometheus

Grafana

InfiniBand

RDMA

Description du poste

Position: Head of Data Center Operations – GPU & AI Infrastructure

Location- Remote with flexibility for travel to data center sites

Role Overview

We are looking for an experienced infrastructure leader to manage and scale large-scale

GPU and AI data center operations. The role requires strong technical expertise in NVIDIA

GPU clusters, high-performance computing (HPC), infrastructure reliability, and leadership

of mission-critical operations teams.

Key Responsibilities

• Lead end-to-end operations of large-scale GPU clusters, AI infrastructure, and
• Manage GPU server deployment, monitoring, troubleshooting, maintenance, and
• hardware lifecycle.
• Ensure high availability, performance, and reliability of AI training and inference
• infrastructure.
• Oversee multi-site data center operations, infrastructure expansion, and capacity
• planning.
• Lead major incident management, RCA, operational governance, and SLA/SLO
• performance.
• Build and manage 24/7 technical operations teams, engineering managers, and site
• leaders.
• Drive automation, GPU fleet monitoring, operational efficiency, and infrastructure
• Scaling.
• Collaborate with engineering teams, hardware vendors, and executive leadership.

Required Skills

• 15+ years in Infrastructure Engineering, Data Center Operations, GPU Cloud, or
• HPC environments.7+ years of leadership experience managing large-scale production infrastructure
• operations.
• Direct experience managing production NVIDIA GPU clusters is mandatory.
• Strong knowledge of NVIDIA H100/H200/B200/GB200, DGX/HGX, NVLink, and
• NVSwitch or comparable GPU infrastructure.Experience with InfiniBand, RDMA, high-speed networking, Linux, and GPU
• hardware troubleshooting.
• Familiarity with Slurm, Kubernetes, NVIDIA DCGM, Prometheus, and Grafana.
• and technical teams.
• Strong leadership, operational strategy, and executive stakeholder management