Member of Technical Staff, Model Training (infra & platform), Remote- Full TIme

Xperteez Technology

United States

Remote

USD 180,000 - 260,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

eBSI Export Academy seeks a Member of Technical Staff, Model Training to own distributed systems and platforms enabling researchers to train large-scale models, run experiments, and deploy AI systems efficiently. The role covers training pipelines, GPU infrastructure, and orchestration across SFT, RL, and OPD workloads.

You will design scalable training and inference pipelines, optimize GPU utilization, and drive architectural decisions while mentoring engineers in a fast-moving research

Qualifications

  • Strong foundations in distributed systems, concurrency, networking, and performance engineering.
  • Experience designing and operating scalable backend systems or distributed compute platforms.
  • Proficiency in Python and a systems language like C++, Rust, or Go.
  • Hands-on GPU ML infrastructure, distributed training, and large-scale compute orchestration.
  • Ability to own architecture decisions and lead cross-functional initiatives.

Responsibilities

  • Architect, build, and scale shared infra for SFT, RL, and OPD workloads.
  • Design pipelines coordinating GPU workers, teacher-model inference, and simulations.
  • Develop high-performance training/inference infra with GPU utilization optimizations.
  • Lead engineering initiatives from design to production, mentoring engineers.
  • Ensure observability, versioning, and reproducibility across experiments.
  • Identify bottlenecks to reduce turnaround time for complex workloads.
  • Define platform interfaces and patterns to support research and engineering teams.
  • Collaborate across research, infra, and applied engineering teams.

Skills

Distributed ML Training
GPU Performance
Distributed Systems
Technical Leadership

Job description

Job Title: Member of Technical Staff, Model Training (infra & platform)

Job Type: Full-time

Location: Remote

Required Skills
  • Distributed ML Training Infrastructure
  • GPU Performance & Inference Optimization
  • Distributed Systems & Platform Architecture
  • Technical Leadership & System Ownership
The Role:

In this role, you will take technical ownership of the distributed systems and platforms that enable researchers to train increasingly capable models, execute large-scale experiments, and deploy specialized AI systems efficiently.

You will work across distributed training, GPU infrastructure, inference optimization, simulation environments, and agent execution frameworks, making critical architectural decisions that directly influence research velocity and model performance.

What You'll Do:
  • Architect, build, and scale shared infrastructure for supervised fine-tuning (SFT), reinforcement learning (RL), and on-policy distillation (OPD), supporting language, multimodal, and robotics workloads.
  • Design distributed training and execution pipelines that coordinate GPU workers, rollout generation, teacher-model inference, reward computation, and simulation environments.
  • Develop high-performance infrastructure for model training and inference, optimizing GPU utilization, memory management, communication, storage, and distributed execution.
  • Build and evolve the core architecture of micro1's agent ecosystem, including execution runtimes, tool interfaces, environment integrations, model registries, and serving APIs.
  • Develop robust systems for experiment tracking, dataset and model versioning, checkpointing, fault recovery, and observability to improve research reproducibility and operational reliability.
  • Identify and eliminate infrastructure bottlenecks, reducing experiment turnaround time and enabling researchers to run increasingly complex training workloads.
  • Define technical standards, platform interfaces, and architectural patterns that support collaboration across research, infrastructure, and applied engineering teams.
  • Lead critical engineering initiatives from system design through implementation and production operations, mentoring engineers while maintaining direct ownership of technically challenging components.
What We're Looking For:
  • Strong computer science fundamentals, particularly in distributed systems, concurrency, networking, and performance engineering.
  • Extensive experience designing, building, and operating scalable backend systems or distributed computing platforms.
  • Proficiency in Python and at least one systems-oriented programming language, such as C++, Rust, or Go.
  • Hands-on experience with GPU-based machine learning infrastructure, distributed training, model inference, or large-scale compute orchestration.
  • Strong understanding of system performance, including compute utilization, memory efficiency, communication overhead, scheduling, and fault tolerance.
  • Experience designing reliable APIs, services, and infrastructure components that support complex engineering or research workflows.
  • Demonstrated technical ownership, including making architectural decisions, leading cross-functional initiatives, and delivering systems that other engineers depend on.
  • Ability to operate effectively in fast-moving research environments where requirements evolve and infrastructure must support rapid experimentation.
Nice to Have:
  • Experience with distributed ML frameworks and technologies such as PyTorch Distributed, DeepSpeed, Ray, Megatron-LM, or similar systems.
  • Familiarity with GPU inference engines and optimization frameworks such as vLLM, TensorRT-LLM, or equivalent technologies.
  • Experience building reinforcement learning infrastructure, rollout orchestration systems, or distributed agent execution environments.
  • Knowledge of CUDA, GPU kernel optimization, NCCL, or low-level GPU performance engineering.
  • Experience with Kubernetes, container orchestration, cluster scheduling, and cloud-based GPU infrastructure.
  • Familiarity with simulation platforms, robotics infrastructure, or large-scale agent evaluation systems.
  • Contributions to open-source infrastructure, distributed computing frameworks, or high-performance machine learning systems.
Compensation & Benefits Notice:

All employees are eligible for equity compensation, and employees may also receive performance-based bonuses, dependent on role and subject to company policies.

Originally posted on Himalayas

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff, Model Training (infra & platform)
Member of Technical Staff, Model Training (infra & platform)

Micro1 • United States

Remote
USD 180,000 - 260,000
Member of Technical Staff, Model Training (infra & platform)
Member of Technical Staff, Model Training (infra & platform)

Remotebridge • United States

Remote
USD 200,000 - 320,000
Equity compensation
Remote-first culture
Health insurance reimbursement up to 4
Member of Technical Staff, Model Training (infra & platform)
Member of Technical Staff, Model Training (infra & platform)

Confidential • United States

Remote
USD 200,000 - 320,000
Remote-first culture
Member of Technical Staff, MLSys
Member of Technical Staff, MLSys

Bake AI Inc. • San Mateo (CA)

On-site
USD 180,000 - 240,000
Member of Technical Staff, ML Systems
Member of Technical Staff, ML Systems

true-talent-solutions-partners • Menlo Park (CA)

On-site
USD 180,000 - 230,000
Member of Technical Staff, GPU & Distributed Systems
Member of Technical Staff, GPU & Distributed Systems

Reactor • San Francisco (CA)

On-site
USD 160,000 - 230,000
Member of Technical Staff, ML Systems — Confidential AI Infrastructure Startup
Member of Technical Staff, ML Systems — Confidential AI Infrastructure Startup

Aionia Group • Menlo Park (CA)

On-site
USD 150,000 - 210,000
Member of Technical Staff - ML Systems
Member of Technical Staff - ML Systems

NextToken AI Inc. • Mountain View (CA)

On-site
USD 180,000 - 250,000
ML Systems Engineer: Inference & GPU-Driven Distributed Workloads
ML Systems Engineer: Inference & GPU-Driven Distributed Workloads

Bake AI Inc. • San Mateo (CA)

Hybrid
USD 180,000 - 240,000
Member of Technical Staff, ML Engineer
Member of Technical Staff, ML Engineer

Acceler8 Talent • Massachusetts

Hybrid
USD 180,000 - 240,000