Head of Scalable AI Infrastructure & SRE

RunPod

United States

Remote

USD 225,000 - 325,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Stock options
Remote-first culture
Competitive salary
Home Office stipend
Flexible PTO

Job summary

Runpod, the AI Developer Cloud, seeks a Director of Infrastructure Engineering to lead and scale core cloud and bare-metal environments. You will own SRE, networking, and storage, drive HPC and RoCE optimization, and build a high-performing, remote-first organization delivering ultra-low latency AI workloads.

You will partner with Product Engineering, GTM, and leadership to forecast capacity, shape roadmaps, and ensure reliability, observability, and rapid delivery at scale.

Qualifications

  • 7+ years engineering leadership of software, infrastructure, SRE, or networking teams, including managers.
  • 8+ years building and operating large-scale distributed systems and bare-metal infrastructure.
  • Hands-on or strong architectural understanding of ultra-low latency networking (InfiniBand/RoCE).
  • Experience with high-performance distributed storage systems and parallel file systems (Ceph, Lustre, NVMe-oF).
  • Strong foundation in reliability engineering, IaC (Terraform/Ansible), Kubernetes, and observability stacks.
  • Experience building culture and accountability across distributed teams in a remote-first environment.
  • Clear communication, stakeholder management, and incident leadership.

Responsibilities

  • Own Core Infrastructure & SRE: lead teams for SRE, networking, and storage with defined SLAs/SLOs and incident response.
  • Architect HPC and Global Networking: manage global network backbone and low-latency GPU training networks; optimize RoCE deployment.
  • Drive Storage Engine Innovation: oversee scalable storage architectures with high IOPS and throughput for AI workloads.
  • Build a High-Output Org: hire and mentor engineering managers and senior ICs; foster ownership and operational excellence in a remote-first setting.
  • Translate Scale into Strategy: forecast capacity, shape roadmaps, and define clear technical scopes and milestones.
  • Improve Systems & Flow: drive improvements in deployment frequency, MTTR, IaC coverage, and uptime.
  • Architectural Stewardship: oversee bare-metal provisioning, virtualization layers, network fabrics, and storage clusters.

Tools

Terraform
Ansible
Kubernetes
Ceph
Lustre
NVMe-oF
InfiniBand
RoCE
Networking
SRE
Cloud platforms

Job description

Runpod, the AI Developer Cloud, seeks a Director of Infrastructure Engineering to lead and scale core cloud and bare-metal environments. You will own SRE, networking, and storage, drive HPC and RoCE optimization, and build a high-performing, remote-first organization delivering ultra-low latency AI workloads.

You will partner with Product Engineering, GTM, and leadership to forecast capacity, shape roadmaps, and ensure reliability, observability, and rapid delivery at scale.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Director of AI Platform & Developer Experience
Remote Director of AI Platform & Developer Experience

RunPod • Mount Laurel Township (NJ)

Remote
USD 225,000 - 325,000
Equity
Medical, Dental & Vision
Flexible PTO
+2
Remote Engineering Manager - AI Platform & Cloud Infra
Remote Engineering Manager - AI Platform & Cloud Infra

RunPod • Mount Laurel Township (NJ)

Remote
USD 110,000 - 220,000
Equity
Medical/dental/vision benefits
Home Office stipend
+2
Director, Global AI Infrastructure & SRE
Director, Global AI Infrastructure & SRE

The POD Network • United States

Remote
PLN 852,918 - 1,231,993
Stock options
Medical, dental & vision plans
Flexible PTO
+2
Remote SRE: AI Platform Reliability & Automation
Remote SRE: AI Platform Reliability & Automation

RunPod • United States

Remote
USD 150,000 - 200,000
Remote work first
Competitive base salary
Stock options equity
+2
Director of Security: Scale Cloud Trust & Resilience
Director of Security: Scale Cloud Trust & Resilience

RunPod • United States

Remote
USD 125,000 - 220,000
Meaningful equity
Medical, dental & vision plans
Flexible PTO
+2
Technical Program Manager, AI Cloud & Scale (Remote)
Technical Program Manager, AI Cloud & Scale (Remote)

RunPod • United States

Remote
USD 140,000 - 165,000
Equity in fast-growing startup
Medical, dental & vision plans
Flexible PTO
+2
Engineering Manager, AI Infra & Cloud Platforms
Engineering Manager, AI Infra & Cloud Platforms

RunPod • United States

Remote
USD 110,000 - 220,000
Stock options
Remote-first culture
Home office stipend
Remote AI Cloud Program Manager
Remote AI Cloud Program Manager

RunPod • United States

Remote
USD 130,000 - 190,000
Equity
Flexible PTO
Medical insurance
+2
Director of Cloud Security & Trust
Director of Cloud Security & Trust

RunPod • Mount Laurel Township (NJ)

Remote
USD 125,000 - 220,000
Competitive base pay
Equity
Medical benefits
+3
Remote-First Global Infra Operations Lead, AI Compute
Remote-First Global Infra Operations Lead, AI Compute

Runware • San Francisco (CA)

Remote
USD 210,000 - 320,000
Stock options
Remote-first culture
Generous PTO and paid family leave
+1