ML Infra Engineer: GPU Fleet & Inference Orchestrator

Generalist; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Job summary

Generalist is seeking a candidate to manage GPU fleets for training large-scale AI models. You will optimize ML data loading, storage, and orchestration of robot inference fleets in compute-constrained environments. Ideal candidates have deep experience with GPUs, Slurm or Kubernetes, and a strong understanding of the ML hardware stack.

Your role will significantly contribute to making general-purpose robots a reality. Join a team from leading AI labs committed to pioneering robotics and AI advancements.

Qualifications

• Managed large fleets of GPUs for ML training or inference.
• Experience in orchestrating workflows using Slurm or Kubernetes.
• Built systems for high-scale data loading.

Responsibilities

• Own GPU compute fleets.
• Ensure usability and maximization of GPU resources.
• Optimize ML data loading and storage.
• Orchestrate robot inference fleets.

Skills

GPU management

ML workload orchestration (Slurm/Kubernetes)

High-scale data loading

Understanding of ML hardware stack

Experience with NVidia GPUs

Job description

Generalist is seeking a candidate to manage GPU fleets for training large-scale AI models. You will optimize ML data loading, storage, and orchestration of robot inference fleets in compute-constrained environments. Ideal candidates have deep experience with GPUs, Slurm or Kubernetes, and a strong understanding of the ML hardware stack.

Your role will significantly contribute to making general-purpose robots a reality. Join a team from leading AI labs committed to pioneering robotics and AI advancements.