Remote GPU Cloud Infrastructure Engineer

Runpod; United States; On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Home Office & Equipment Stipend

Equity in company

Comprehensive health plans

Flexible PTO

Remote-first culture

On-call readiness potential

Job summary

Runpod, the AI Developer Cloud, seeks a Datacenter Infrastructure Specialist to own the technical lifecycle and health of our GPU fleet. You’ll bridge hardware partners and internal teams, solving complex HPC/network challenges at scale.

You will work with cutting-edge GPU cloud tech, RDMA fabrics, and observability stacks to automate and improve reliability, uptime, and performance across a global infrastructure.

Qualifications

• 3–5 years of experience in infrastructure operations, systems reliability, or datacenter engineering.
• Strong proficiency in datacenter networking and performance troubleshooting.
• Hands-on with NVIDIA Software Stack and multi-node performance tuning.

Responsibilities

• Validate new hardware and verify deployments meet Runpod specs for AI/ML workloads.
• Monitor fleet health and enforce SLAs with data-driven audits of downtime.
• Work with AI agents to automate network triage and runbooks.
• Coordinate incident communications and provide actionable resolutions.
• Support growth of infrastructure partners.

Skills

Datacenter networking

Linux administration

Docker

Python/Go/Bash

Effective communication

On-call readiness

Education

Bachelor’s degree in CS or related

Tools

Grafana

Prometheus

Datadog

InfiniBand/RDMA

RoCE

Job description

Runpod, the AI Developer Cloud, seeks a Datacenter Infrastructure Specialist to own the technical lifecycle and health of our GPU fleet. You’ll bridge hardware partners and internal teams, solving complex HPC/network challenges at scale.

You will work with cutting-edge GPU cloud tech, RDMA fabrics, and observability stacks to automate and improve reliability, uptime, and performance across a global infrastructure.