ML Infra Engineer - Scale GPU Clusters & Simulation

Zeromatter

Mountain View (CA)

Sur place

USD 100 000 - 300 000

Plein temps

Il y a 4 heures
Soyez parmi les premiers à postuler

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Avantages offerts par ce poste

Equity
Medical, dental, vision insurance

Résumé du poste

Zeromatter in Mountain View, CA is hiring an ML Infrastructure Engineer to design, deploy, and operate GPU clusters for large-scale simulation and training. You will build distributed training pipelines with PyTorch DDP/FSDP, manage cloud and on-prem resources, and ship scalable inference and data platforms.

Ideal candidates have 5+ years in software or ML infra, strong Python and systems language skills (C++, Rust, or Go), and hands-on experience with Kubernetes and cloud providers.

Qualifications

  • Ideally, you have an engineering degree in a related field (e.g. computer science, mechanical engineering, physics, math, robotics, etc.)
  • ML infra experience in autonomy, robotics, aerospace, or another simulation-heavy domain
  • RL or closed-loop training infrastructure, where a simulator or environment runs inside the training loop
  • Familiarity with GPU rendering and graphics APIs (Vulkan, CUDA interop), or feeding rendered sensor data into training
  • Large-model training: tensor and pipeline parallelism, NCCL tuning, mixed precision
  • GPU profiling and telemetry tools such as Nsight Systems, the PyTorch profiler, and DCGM
  • Training-native data formats (WebDataset, Parquet, Lance) and GPU-side video or image decode
  • Ray or KubeRay, Kueue or Volcano, and experiment tracking (Weights & Biases, MLflow)
  • HPC background: schedulers, parallel file systems, and high-speed interconnects (InfiniBand, RoCE)
  • Deploying and optimizing models for edge hardware (TensorRT, ONNX), including in customer, air-gapped, or regulated environments

Responsabilités

  • Ideally, you have an engineering degree in a related field (e.g. computer science, mechanical engineering, physics, math, robotics, etc.)
  • 5+ years of software engineering, with substantial production work on distributed systems or ML infrastructure
  • Hands-on experience building and operating GPU clusters for training at meaningful scale (roughly 100+ GPUs), including failures that only appear at scale: hung collectives, stragglers, input-bound jobs, stranded capacity
  • Strong Python, plus one systems language such as C++, Rust, or Go
  • Working knowledge of PyTorch and distributed training concepts (DDP, FSDP, NCCL, sharding, checkpointing)
  • Experience with Kubernetes and at least one major cloud (AWS, GCP, or Azure) or large on-prem GPU infrastructure
  • Comfort with infrastructure as code (Terraform or equivalent), containers, and CI/CD
  • Sound judgment on trade-offs such as cloud versus on-prem, build versus buy, and speed versus cost, and clear communication with the engineers who use your platform

Connaissances

Python
Distributed systems
PyTorch
Kubernetes
C++
Rust
Go
Cloud platforms (AWS/GCP/Azure)
Terraform
CI/CD

Formation

Engineering degree in CS/Mech Eng/Physics/Math/Robotics

Outils

Nsight Systems
PyTorch profiler
DCGM
WebDataset
Weights & Biases
MLflow
CUDA interop

Description du poste

Zeromatter in Mountain View, CA is hiring an ML Infrastructure Engineer to design, deploy, and operate GPU clusters for large-scale simulation and training. You will build distributed training pipelines with PyTorch DDP/FSDP, manage cloud and on-prem resources, and ship scalable inference and data platforms.

Ideal candidates have 5+ years in software or ML infra, strong Python and systems language skills (C++, Rust, or Go), and hands-on experience with Kubernetes and cloud providers.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

ML Infra Engineer
ML Infra Engineer

Zeromatter • Mountain View (CA)

Sur place
USD 100 000 - 300 000
Equity
Medical, dental, vision insurance
Senior ML Infra Engineer: Build & Scale AI Systems
Senior ML Infra Engineer: Build & Scale AI Systems

Goliath Partners Inc. • San Francisco (CA)

Sur place
USD 180 000 - 240 000
GPU Supercomputing Engineer for Large-Scale ML Training
GPU Supercomputing Engineer for Large-Scale ML Training

Bison • San Francisco (CA)

Sur place
USD 350 000 - 475 000
Health/dental/vision
Unlimited PTO
Parental leave
+1
Remote ML Infra Engineer for Large-Scale AI Training
Remote ML Infra Engineer for Large-Scale AI Training

true-talent-solutions-partners • San Francisco (CA)

À distance
USD 200 000 - 400 000
Remote-friendly
Competitive salary
ML Infra Engineer: GPU Fleet & Inference Orchestrator
ML Infra Engineer: GPU Fleet & Inference Orchestrator

Generalist • San Francisco (CA)

Sur place
USD 120 000 - 160 000
ML Infra Engineer: Scale & Optimize Large-Scale Training
ML Infra Engineer: Scale & Optimize Large-Scale Training

Physical Intelligence • San Francisco (CA)

Sur place
USD 180 000 - 240 000
ML Infra Engineer: GPU Compute & Pipelines
ML Infra Engineer: GPU Compute & Pipelines

SpaceXSI • Palo Alto (CA)

Sur place
USD 180 000 - 440 000
Equity
Medical, vision, dental
401(k)
+3
ML Infra Engineer: GPU Fleet & Inference Orchestration
ML Infra Engineer: GPU Fleet & Inference Orchestration

Generalist • Somerville (NJ)

Sur place
USD 140 000 - 190 000
Software Engineer: ML Infra
Software Engineer: ML Infra

Generalist • Somerville (MA), San Mateo (CA)

Sur place
USD 120 000 - 160 000
Senior ML Infra Engineer - Large-Scale Training & Pipelines
Senior ML Infra Engineer - Large-Scale Training & Pipelines

Kindredventures • San Francisco (CA)

Sur place
USD 160 000 - 220 000