Lead GPU Infrastructure Reliability Engineer

Socrates

United States

Remote

USD 180,000 - 240,000

Full time

11 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive compensation
Equity
Medical, dental, vision
Flexible time off
Company breaks

Job summary

Socrates is seeking a Senior GPU Infra Engineer to own the zero-to-one build-out of Socrates GRID, designing compute, network, storage, and management architecture for large-scale deployment. You will drive SRE practices and ensure performance, availability, and cost targets are met.

Lead provisioning automation, capacity planning, and multi-site expansion, coordinating with platform engineers and OEMs. Hands-on GPU hardware expertise is essential for production-scale clusters.

Qualifications

  • Must have built and operated production GPU infrastructure.
  • Deep understanding of GPU memory, interconnects, CPU topology, PCIe lanes, and power/thermals.
  • Ability to trace bottlenecks in the physical system.
  • Experience with high-speed cluster networking (InfiniBand or RoCE).
  • Experience shipping production software and automation in Python or Go.

Responsibilities

  • Design compute, network, storage, and management architecture for Socrates GRID.
  • Bring first capacity online and make expansions repeatable.
  • Own SRE with measurable performance, availability, recovery, and cost.
  • Automate provisioning, configuration, health checks, upgrades, failure isolation.
  • Define service-level objectives and incident reviews.

Skills

GPU infra
Server selection
GPU memory
GPU diagnostics
High-speed networking
Python
Go
SRE
Inference ops
Vendor coordination

Tools

CI/CD pipelines

Job description

Socrates is seeking a Senior GPU Infra Engineer to own the zero-to-one build-out of Socrates GRID, designing compute, network, storage, and management architecture for large-scale deployment. You will drive SRE practices and ensure performance, availability, and cost targets are met.

Lead provisioning automation, capacity planning, and multi-site expansion, coordinating with platform engineers and OEMs. Hands-on GPU hardware expertise is essential for production-scale clusters.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Hardware Reliability Engineer
Hardware Reliability Engineer

Socrates Systems Inc • United States

Remote
USD 180,000 - 240,000
Competitive compensation
Equity
Medical, dental, vision
+2
Senior GPU Cloud Infrastructure Engineer
Senior GPU Cloud Infrastructure Engineer

Hyperbolic • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior GPU Infrastructure Engineer
Senior GPU Infrastructure Engineer

Career Movement • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior SRE — GPU Infra, Auto-Healing & Automation
Senior SRE — GPU Infra, Auto-Healing & Automation

Salesonaut • Santa Clara (CA)

On-site
USD 168,000 - 270,000
Equity
Benefits package
Senior GPU Infrastructure & Automation Engineer
Senior GPU Infrastructure & Automation Engineer

Crusoe • San Francisco (CA)

On-site
USD 250,000 - 300,000
Industry competitive pay
Restricted Stock Units
Health insurance
+7
Senior SRE: GPU Fleet Orchestration & Auto-Scaling
Senior SRE: GPU Fleet Orchestration & Auto-Scaling

Hippocratic AI • Menlo Park (CA)

On-site
USD 180,000 - 240,000
Lead Production Engineering for GPU Compute Ops
Lead Production Engineering for GPU Compute Ops

Fluidstack • Seattle (WA)

On-site
USD 225,000 - 284,000
Lead GPU HPC Infrastructure Engineer
Lead GPU HPC Infrastructure Engineer

Sciforium • San Francisco (CA)

On-site
USD 180,000 - 240,000
Medical, dental, and vision insurance
401k plan
Daily lunch, snacks, and beverages
+2
Senior GPU Infrastructure Engineer - Production & Automation
Senior GPU Infrastructure Engineer - Production & Automation

ByteDance • San Jose (CA)

On-site
USD 122,000 - 272,000
Remote Senior GPU Infrastructure SRE for AI Scale
Remote Senior GPU Infrastructure SRE for AI Scale

Andromeda Cluster • United States

Remote
USD 180,000 - 280,000