Senior ML Infra Architect – Distributed Training & GPUs

Xperteez Technology

United States

Remote

USD 180,000 - 260,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

eBSI Export Academy seeks a Member of Technical Staff, Model Training to own distributed systems and platforms enabling researchers to train large-scale models, run experiments, and deploy AI systems efficiently. The role covers training pipelines, GPU infrastructure, and orchestration across SFT, RL, and OPD workloads.

You will design scalable training and inference pipelines, optimize GPU utilization, and drive architectural decisions while mentoring engineers in a fast-moving research

Qualifications

  • Strong foundations in distributed systems, concurrency, networking, and performance engineering.
  • Experience designing and operating scalable backend systems or distributed compute platforms.
  • Proficiency in Python and a systems language like C++, Rust, or Go.
  • Hands-on GPU ML infrastructure, distributed training, and large-scale compute orchestration.
  • Ability to own architecture decisions and lead cross-functional initiatives.

Responsibilities

  • Architect, build, and scale shared infra for SFT, RL, and OPD workloads.
  • Design pipelines coordinating GPU workers, teacher-model inference, and simulations.
  • Develop high-performance training/inference infra with GPU utilization optimizations.
  • Lead engineering initiatives from design to production, mentoring engineers.
  • Ensure observability, versioning, and reproducibility across experiments.
  • Identify bottlenecks to reduce turnaround time for complex workloads.
  • Define platform interfaces and patterns to support research and engineering teams.
  • Collaborate across research, infra, and applied engineering teams.

Skills

Distributed ML Training
GPU Performance
Distributed Systems
Technical Leadership

Job description

eBSI Export Academy seeks a Member of Technical Staff, Model Training to own distributed systems and platforms enabling researchers to train large-scale models, run experiments, and deploy AI systems efficiently. The role covers training pipelines, GPU infrastructure, and orchestration across SFT, RL, and OPD workloads.

You will design scalable training and inference pipelines, optimize GPU utilization, and drive architectural decisions while mentoring engineers in a fast-moving research

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff, Model Training (infra & platform)
Member of Technical Staff, Model Training (infra & platform)

Micro1 • United States

Remote
USD 180,000 - 260,000
Senior ML Training Systems Engineer - Distributed GPU Infra
Senior ML Training Systems Engineer - Distributed GPU Infra

Baseten • San Francisco (CA)

On-site
USD 150,000 - 200,000
Competitive compensation, including equity
100% coverage of medical, dental, and vision insurance
Generous PTO policy
+2
Remote Lead, Distributed ML Training Infra
Remote Lead, Distributed ML Training Infra

Remotebridge • United States

Remote
USD 200,000 - 320,000
Equity compensation
Remote-first culture
Health insurance reimbursement up to 4
Staff Engineer - Distributed AI Infrastructure & Systems
Staff Engineer - Distributed AI Infrastructure & Systems

Micro1 • United States

Remote
USD 180,000 - 260,000
Staff ML Systems Engineer - GPU & Distributed Training
Staff ML Systems Engineer - GPU & Distributed Training

true-talent-solutions-partners • Menlo Park (CA)

On-site
USD 180,000 - 230,000
Member of Technical Staff, Model Training (infra & platform), Remote- Full TIme
Member of Technical Staff, Model Training (infra & platform), Remote- Full TIme

Xperteez Technology • United States

Remote
USD 180,000 - 260,000
Senior ML Infra Engineer - Large-Scale Training & Pipelines
Senior ML Infra Engineer - Large-Scale Training & Pipelines

Kindredventures • San Francisco (CA)

On-site
USD 160,000 - 220,000
Distributed Training Systems Engineer
Distributed Training Systems Engineer

Reflection AI Ltd • New York (NY)

On-site
USD 180,000 - 270,000
Top-tier compensation
Stock options
Health & wellness
+5
Senior ML Infra Engineer for Distributed GPU Training
Senior ML Infra Engineer for Distributed GPU Training

Genesis Molecular AI • City of Utica (NY)

On-site
USD 150,000 - 190,000
Competitive compensation with salary +
Senior ML Infra Research Engineer — Distributed Training
Senior ML Infra Research Engineer — Distributed Training

present of AI • San Francisco (CA)

On-site
USD 180,000 - 250,000