Senior Distributed GPU Infra Engineer

LinuxCareers; San Francisco (CA); On-site; USD 180,000 - 250,000; Full time

Job summary

LinuxCareers is seeking an experienced engineer to design, deploy, and operate large-scale GPU clusters for an AI research team in San Francisco. You will extend Kubernetes and Slurm, build self-serve tooling for researchers, and own storage and logs with robust retention and lineage.

You will monitor reliability, implement observability, and partner with researchers to optimize performance and placement across training and inference workloads.

Qualifications

• Experience operating large-scale GPU clusters and container orchestration.
• Strong systems background in Linux, networking, storage, and IaC.
• Familiarity with ML/AI workloads and distributed systems patterns.

Responsibilities

• Design, deploy, and operate large distributed GPU clusters end-to-end.
• Extend scheduling and orchestration systems for multi-tenancy across workloads.
• Build software that abstracts cluster management with a self-serve interface.
• Own cluster storage and artifact paths with retention and lineage.
• Monitor reliability and observability; improve failure detection.
• Collaborate with researchers to optimize performance and placement.

Skills

Distributed systems

SRE fundamentals

Autonomous execution

Research collaboration

Tools

Kubernetes

Slurm

Docker

Terraform

Job description

LinuxCareers is seeking an experienced engineer to design, deploy, and operate large-scale GPU clusters for an AI research team in San Francisco. You will extend Kubernetes and Slurm, build self-serve tooling for researchers, and own storage and logs with robust retention and lineage.

You will monitor reliability, implement observability, and partner with researchers to optimize performance and placement across training and inference workloads.