ML Infra & GPU Fleet Engineer

Generalist; Somerville, San Mateo (MA, CA); On-site; USD 120,000 - 160,000; Full time

Job summary

Generalist is seeking a talented individual in Somerville, Massachusetts to manage GPU fleets for large-scale robot training. The role involves optimizing data loading systems and orchestrating inference fleets, ensuring high performance under compute constraints.

The ideal candidate has deep experience with Slurm or Kubernetes for machine learning orchestration and a solid understanding of the Nvidia GPU ecosystem. Come join an equal opportunity employer that values diversity!

Qualifications

• Experience managing large fleets of GPUs for distributed training.
• Deep experience with Slurm or Kubernetes for ML workloads.
• Knowledge in building high-scale ML data loaders.

Responsibilities

• Own the GPU compute fleets and ensure maximal utilization.
• Optimize ML data loading transport and storage.
• Orchestrate robot inference fleets.

Skills

GPU resource management

ML workload orchestration (Slurm or Kubernetes)

Data loading optimization

Understanding of ML hardware

Experience in NVidia GPU ecosystem

Job description

Generalist is seeking a talented individual in Somerville, Massachusetts to manage GPU fleets for large-scale robot training. The role involves optimizing data loading systems and orchestrating inference fleets, ensuring high performance under compute constraints.

The ideal candidate has deep experience with Slurm or Kubernetes for machine learning orchestration and a solid understanding of the Nvidia GPU ecosystem. Come join an equal opportunity employer that values diversity!