Remote Lead, Distributed ML Training Infra

Remotebridge; United States; Remote; USD 200,000 - 320,000; Full time

Benefits offered by this job

Equity compensation

Remote-first culture

Health insurance reimbursement up to 4

Job summary

micro1 is seeking a Member of Technical Staff, Model Training (infra & platform) to own the distributed systems that power researchers training large models, running extensive experiments, and deploying specialized AI systems at scale.

You will design pipelines for SFT, RL, and OPD, optimize GPU usage, build robust experiment tracking, and mentor engineers while delivering reliable, high-performance backend infrastructure in a remote-first environment.

Qualifications

• Strong fundamentals in distributed systems, concurrency, networking, and performance engineering.
• Extensive experience designing, building, and operating scalable backend systems or distributed platforms.
• Proficiency in Python and at least one systems language (C++, Rust, or Go).
• Hands-on experience with GPU ML infra, distributed training, model inference, or large-scale compute orchestration.

Responsibilities

• Architect, build, and scale shared infra for SFT, RL, and OPD workloads across language, multimodal, and robotics tasks.
• Design training/execution pipelines coordinating GPU workers, teacher-model inference, rewards, and simulations.
• Develop high-performance infra for training/inference, optimizing GPU usage, memory, and distributed execution.
• Evolve the core architecture of the agent ecosystem, including runtimes, interfaces, environments, registries, and APIs.
• Implement robust experiment tracking, dataset/model versioning, checkpointing, fault recovery, and observability.
• Eliminate infra bottlenecks to speed up experiments and enable complex workloads.
• Define standards and patterns to support collaboration across research and engineering teams.
• Lead initiatives from design to production, mentoring engineers while owning critical components.

Skills

Distributed systems

GPU infrastructure

Python

Systems programming

API design

Fault tolerance

Technical ownership

Training orchestration

Tools

PyTorch

DeepSpeed

Ray

Megatron-LM

Kubernetes

TensorRT-LLM

CUDA

NCCL

Job description

micro1 is seeking a Member of Technical Staff, Model Training (infra & platform) to own the distributed systems that power researchers training large models, running extensive experiments, and deploying specialized AI systems at scale.

You will design pipelines for SFT, RL, and OPD, optimize GPU usage, build robust experiment tracking, and mentor engineers while delivering reliable, high-performance backend infrastructure in a remote-first environment.