Senior GPU SRE – Distributed AI Compute Infra

Andromeda Cluster

Oregon

Hybrid

USD 180,000 - 260,000

Full time

10 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Andromeda Cluster is seeking a Senior Site Reliability Engineer to design, operate, and debug large-scale GPU infrastructure used for distributed training and inference. You will work directly with customers pushing the limits of modern AI systems and own capacity planning across heterogeneous GPU fleets.

You will lead incident responses, drive blameless postmortems, and build automation for cluster provisioning, GPU health checks, and firmware/driver lifecycle management.

Qualifications

  • Deep, hands-on experience operating large-scale GPU clusters (NVIDIA A100/H100/B200 or equivalent).
  • Production experience with GPU networking fabrics (InfiniBand, RoCE, NVLink).
  • Experience with NCCL, CUDA, PyTorch distributed, DeepSpeed, Megatron, FSDP or similar.

Responsibilities

  • Design and evolve multi-provider, multi-region GPU compute clusters optimized for large-scale training.
  • Serve as the primary technical contact for customers running large-scale training workloads.
  • Define SLOs and error budgets for GPU infrastructure and own capacity planning.

Skills

GPU systems expertise
High-performance networking
Distributed training & ML frameworks
Linux & systems internals
Kubernetes & orchestration
Automation & software engineering
Observability & monitoring
Incident management
Team leadership

Job description

Andromeda Cluster is seeking a Senior Site Reliability Engineer to design, operate, and debug large-scale GPU infrastructure used for distributed training and inference. You will work directly with customers pushing the limits of modern AI systems and own capacity planning across heterogeneous GPU fleets.

You will lead incident responses, drive blameless postmortems, and build automation for cluster provisioning, GPU health checks, and firmware/driver lifecycle management.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Senior GPU Infrastructure SRE for AI Scale
Remote Senior GPU Infrastructure SRE for AI Scale

Andromeda Cluster • United States

Remote
USD 180,000 - 280,000
Senior GPU Cluster Reliability Engineer — Remote
Senior GPU Cluster Reliability Engineer — Remote

andromeda • United States

Remote
USD 180,000 - 280,000
Senior Site Reliability Engineer
Senior Site Reliability Engineer

Andromeda • San Francisco (CA)

Hybrid
USD 150,000 - 200,000
Significant ownership and autonomy
Inclusive environment
Opportunity to shape AI infrastructure
Senior Site Reliability Engineer
Senior Site Reliability Engineer

Andromeda Cluster • Oregon

Hybrid
USD 180,000 - 260,000
Senior GPU Cluster Architect — Remote
Senior GPU Cluster Architect — Remote

Andromeda • United States

Remote
USD 180,000 - 240,000
Healthcare
Dental
Vision
+2
Senior Site Reliability Engineer
Senior Site Reliability Engineer

Andromeda Cluster • United States

Remote
USD 180,000 - 280,000
Senior AI Infra SRE: GPU Clusters & High-Perf Networking
Senior AI Infra SRE: GPU Clusters & High-Perf Networking

Andromeda • San Francisco (CA)

Hybrid
USD 150,000 - 200,000
Significant ownership and autonomy
Inclusive environment
Opportunity to shape AI infrastructure
Remote Customer Reliability Engineer - AI Compute Platform
Remote Customer Reliability Engineer - AI Compute Platform

Andromeda • United States

Remote
USD 120,000 - 180,000
Senior SRE — GPU Infra, Auto-Healing & Automation
Senior SRE — GPU Infra, Auto-Healing & Automation

Salesonaut • Santa Clara (CA)

On-site
USD 168,000 - 270,000
Equity
Benefits package
On-Site GPU Cluster Deployment Engineer
On-Site GPU Cluster Deployment Engineer

Andromeda • United States

Remote
USD 100,000 - 150,000
Comprehensive benefits