Global AI Infra Architect & SRE Leader

Runpod

Mount Laurel Township (NJ)

On-site

USD 225,000 - 325,000

Full time

8 days ago

Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity

Medical/Dental/Vision

Flexible PTO

Remote-friendly culture

Slack-based collaboration

Home Office stipend

Job summary

Runpod is seeking a Director of Infrastructure Engineering to lead and scale our core cloud and bare-metal environments. You will own SRE, networking, and storage, building the operating rhythm and technical direction for high availability and massive GPU workloads.

You will partner with Product and GTM leadership to forecast capacity, shape roadmaps, and translate scale challenges into clear milestones. This role demands hands-on leadership, IaC discipline, and a track record of delivering

Qualifications

7+ years leading software, infrastructure, SRE, or networking teams including managers.
8+ years building large-scale distributed systems and cloud platforms.
Hands-on or design knowledge of ultra-low latency networks (InfiniBand/RoCE).
Experience with distributed storage (Ceph/Lustre/NVMe-oF).
Strong IaC, Kubernetes, and observability practices.
Remote-first leadership across distributed teams.
Excellent communication and stakeholder management.
Background check clearance.

Responsibilities

Own Core Infra & SRE: lead teams for reliability, SLA/SLOs, observability, and remediation.
Architect HPC & global networking, RoCE, InfiniBand, and WAN routing.
Drive storage engine innovation for high IOPS and throughput.
Build a high-output org: hire, mentor, and grow managers and senior ICs.
Translate scale into strategy with capacity forecasting and roadmaps.
Improve systems & flow: deployment frequency, MTTR, IaC coverage.
Architectural stewardship for bare-metal, virtualization, and storage clusters.
Coordinate with product and platform teams for robust primitives.