Senior ML Training Infrastructure Engineer

Dyna Robotics, Inc; Redwood City, Northern (CA, KY); Hybrid; USD 180,000 - 260,000; Full time

Job summary

Dyna Robotics in Redwood City, CA seeks an ML Training Infrastructure Engineer to architect and build the end-to-end training infrastructure for our multi-cloud GPU fleet. You will ensure every GPU is busy, every run is reproducible, and researchers can run experiments with a single command.

You will own data pipelines, scheduling, and inference pipelines using TensorRT, Triton, and DeepSpeed. The role demands deep HPC/ML infra expertise and a strong ownership mindset.

Qualifications

• 7+ years of engineering experience in HPC or ML infrastructure.
• Proficiency with PyTorch and distributed training (DeepSpeed, Accelerate).
• Cloud GPU management (GCP/AWS) and Kubernetes expertise.
• Low-level distributed systems knowledge including NCCL, memory management, race conditions.
• Ownership mindset to design, build, and operate end-to-end systems.

Responsibilities

• Scale distributed training for large-scale GPU clusters with optimization techniques.
• Build a research codebase and job scheduler using Kubernetes/SLURM.
• Design high-throughput pipelines for terabytes of multimodal data.
• Create low-latency production inference pipelines with TensorRT and Triton.
• Profile GPU utilization, I/O bottlenecks, and memory to maximize compute efficiency.

Skills

7+ years experience

PyTorch

DeepSpeed

Accelerate

Kubernetes

GCP/AWS

NCCL

Distributed systems

Ownership mindset

SLURM

TensorRT

Triton

Job description

Dyna Robotics in Redwood City, CA seeks an ML Training Infrastructure Engineer to architect and build the end-to-end training infrastructure for our multi-cloud GPU fleet. You will ensure every GPU is busy, every run is reproducible, and researchers can run experiments with a single command.

You will own data pipelines, scheduling, and inference pipelines using TensorRT, Triton, and DeepSpeed. The role demands deep HPC/ML infra expertise and a strong ownership mindset.