AI/ML GPU Infra SRE — Build, Scale, Sustain

GMI Cloud, Inc

United States

On-site

USD 120,000 - 170,000

Full time

3 days ago
Be an early applicant
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

GMI Cloud, Inc. is seeking a Site Reliability Engineer to join the Global Infrastructure team. The role emphasizes hands-on management of large-scale AI/ML compute clusters, focusing on stability, efficiency, and reliability across data-center infrastructure.

The ideal candidate will have expertise in system-level troubleshooting, automation, and experience with GPU infrastructure, with travel to data center locations as needed.

Qualifications

  • Bachelor’s degree in Computer Science or related field.
  • 3+ years of experience in data center operations, infrastructure, or systems engineering.
  • Proven experience in site reliability engineering and infrastructure automation (e.g. Ansible, Terraform).
  • Familiarity with containers orchestration platform (Kubernetes) and job scheduling systems (Slurm).
  • Familiarity with Linux system administration and scripting (Python, Bash).
  • Knowledge of logging/metrics tools such as Prometheus, Grafana, Loki.

Responsibilities

  • Design, implement and maintain scalable AI/ML infrastructure solutions.
  • Proactively monitor GPU cluster health, performance and troubleshoot issues across compute, accelerator, and storage systems.
  • Automate deployment, configuration and management of infrastructure resources.
  • Manage GPU node lifecycle workflows including provisioning, scaling, maintenance, decommissioning and upgrades.
  • Implement CI/CD pipelines for infrastructure deployment and orchestration.

Skills

Site Reliability Engineering
Infrastructure automation
Linux
Python scripting
Kubernetes
Terraform
Ansible
GPU

Education

Bachelor's degree in Computer Science

Tools

Ansible
Terraform
Kubernetes
Prometheus
Grafana
NVIDIA CUDA

Job description

GMI Cloud, Inc. is seeking a Site Reliability Engineer to join the Global Infrastructure team. The role emphasizes hands-on management of large-scale AI/ML compute clusters, focusing on stability, efficiency, and reliability across data-center infrastructure.

The ideal candidate will have expertise in system-level troubleshooting, automation, and experience with GPU infrastructure, with travel to data center locations as needed.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead SRE - AI/ML GPU Infra
Lead SRE - AI/ML GPU Infra

GMI Cloud, Inc • United States

On-site
USD 140,000 - 190,000
Kubernetes SRE for AI Infra & GPU Clusters
Kubernetes SRE for AI Infra & GPU Clusters

GMI Cloud • United States

On-site
USD 100,000 - 130,000
Site Reliability Engineer
Site Reliability Engineer

GMI Cloud, Inc • United States

On-site
USD 120,000 - 170,000
Site Reliability Lead
Site Reliability Lead

GMI Cloud, Inc • United States

On-site
USD 140,000 - 190,000
Infra Engineer - SRE(Kubernetes)
Infra Engineer - SRE(Kubernetes)

GMI Cloud • United States

On-site
USD 100,000 - 130,000
Senior AI Infra SRE: GPU Clusters & High-Perf Networking
Senior AI Infra SRE: GPU Clusters & High-Perf Networking

Andromeda • San Francisco (CA)

Hybrid
USD 150,000 - 200,000
Significant ownership and autonomy
Inclusive environment
Opportunity to shape AI infrastructure
SRE for AI Infra & Multi-Cloud Platform
SRE for AI Infra & Multi-Cloud Platform

Mithril • Palo Alto (CA), Northern (KY)

Hybrid
USD 170,000 - 230,000
Health, dental, and vision coverage
401k with company match
14 company holidays; including 2 float
Infra Engineer (SRE) for AI & GPU Compute
Infra Engineer (SRE) for AI & GPU Compute

Blackwing • Detroit (MI), Northern (KY)

Hybrid
USD 140,000 - 190,000
Competitive salary
Equity package
Medical/dental/vision coverage
+5
AI Infra Engineer – SRE (Kubernetes)
AI Infra Engineer – SRE (Kubernetes)

Berrybytes • United States

On-site
USD 110,000 - 150,000
Senior AI Platform SRE: Scale Cloud Infra & Kubernetes
Senior AI Platform SRE: Scale Cloud Infra & Kubernetes

GCS Recruitment • Mount Laurel Township (NJ)

On-site
USD 110,000 - 170,000