Remote Senior GPU Infrastructure SRE for AI Scale

Andromeda Cluster

United States

Remote

USD 180,000 - 280,000

Full time

13 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Andromeda Cluster seeks a Senior Site Reliability Engineer to design, operate, and debug large-scale GPU infrastructure for distributed AI workloads. You will work directly with customers to push the performance and reliability envelope across multi-provider, multi-region clusters.

You will own capacity planning, SLOs, and fault-tolerance for GPU systems, networking fabrics, and orchestration, while building automation and deep observability to support scalable AI compute at scale.

Qualifications

  • Deep, hands-on experience operating large-scale GPU clusters.
  • Production networking with high-speed interconnects for training workloads.
  • Experience with NCCL, CUDA, PyTorch distributed or similar.
  • Expert-level Linux knowledge and driver/tooling experience.
  • Production Kubernetes for GPU workloads and orchestration.
  • Strong programming skills in Python/Go/Bash; IaC tooling.
  • Ability to own incident response for complex systems.

Responsibilities

  • Design and evolve multi-provider GPU compute clusters for large-scale training.
  • Serve as the primary technical contact for customers running large workloads.
  • Define SLOs and manage capacity across diverse GPU fleets.
  • Ensure health of high-speed interconnects and diagnose fabric issues.
  • Build deep observability into GPU utilization and hardware health.
  • Develop automation for provisioning, health checks, and lifecycle management.
  • Lead incident response and drive blameless postmortems.

Skills

GPU Systems
High-Performance Networking
Distributed Training
Linux Internals
Kubernetes
Automation & Tools
Observability
Incident Management

Job description

Andromeda Cluster seeks a Senior Site Reliability Engineer to design, operate, and debug large-scale GPU infrastructure for distributed AI workloads. You will work directly with customers to push the performance and reliability envelope across multi-provider, multi-region clusters.

You will own capacity planning, SLOs, and fault-tolerance for GPU systems, networking fabrics, and orchestration, while building automation and deep observability to support scalable AI compute at scale.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior GPU Cluster Reliability Engineer — Remote
Senior GPU Cluster Reliability Engineer — Remote

andromeda • United States

Remote
USD 180,000 - 280,000
Senior Site Reliability Engineer
Senior Site Reliability Engineer

Andromeda • San Francisco (CA)

Hybrid
USD 150,000 - 200,000
Significant ownership and autonomy
Inclusive environment
Opportunity to shape AI infrastructure
Remote Customer Reliability Engineer - AI Compute Platform
Remote Customer Reliability Engineer - AI Compute Platform

Andromeda • United States

Remote
USD 120,000 - 180,000
Senior Site Reliability Engineer
Senior Site Reliability Engineer

Andromeda Cluster • United States

Remote
USD 180,000 - 280,000
Senior GPU Cluster Architect — Remote
Senior GPU Cluster Architect — Remote

Andromeda • United States

Remote
USD 180,000 - 240,000
Healthcare
Dental
Vision
+2
Remote GPU Deployment Engineer - Scale AI Clusters
Remote GPU Deployment Engineer - Scale AI Clusters

Andromeda • United States

Remote
USD 95,000 - 155,000
Healthcare
Dental
Vision
+2
Remote AI Infrastructure SRE — Kubernetes & Reliability
Remote AI Infrastructure SRE — Kubernetes & Reliability

Andromeda • San Francisco (CA)

Remote
USD 120,000 - 160,000
Remote AI Infra Reliability Engineer
Remote AI Infra Reliability Engineer

Andromeda Cluster • United States

Remote
USD 120,000 - 180,000
Senior SRE: AI Infra & GPU Clusters
Senior SRE: AI Infra & GPU Clusters

Spacex • Palo Alto (CA)

Hybrid
USD 165,000 - 265,000
Stock options
401(k) plan
Medical, vision, and dental coverage
+2
Senior AI Infra SRE: GPU Clusters & High-Perf Networking
Senior AI Infra SRE: GPU Clusters & High-Perf Networking

Andromeda • San Francisco (CA)

Hybrid
USD 150,000 - 200,000
Significant ownership and autonomy
Inclusive environment
Opportunity to shape AI infrastructure