ML Infra Engineer — Scalable Training Systems

Monograph; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Job summary

A leading tech company in San Francisco seeks a Machine Learning Engineer to build and maintain infrastructure for large-scale model training. In this hands-on role, you will design systems, work closely with researchers, and optimize training processes. Candidates should have strong software engineering skills and experience with JAX or PyTorch. Join a dynamic team at the forefront of machine learning and contribute to core training code and systems.

Qualifications

• Strong experience building ML training infrastructure or internal platforms.
• Hands-on experience with large-scale training in JAX or PyTorch.
• Ability to optimize performance across the training stack.

Responsibilities

• Design and maintain systems for large-scale model training.
• Scale JAX-based training across TPU and GPU clusters.
• Optimize memory usage, device utilization, and throughput.

Skills

Software engineering fundamentals

Large-scale training experience in JAX

Distributed training familiarity

Managing training workloads on cloud platforms

Debugging performance bottlenecks

Cross-functional communication

Education

Bachelor's degree in a related field

Tools

JAX

PyTorch

Kubernetes

SLURM

GCP TPU/GKE

AWS

Job description

A leading tech company in San Francisco seeks a Machine Learning Engineer to build and maintain infrastructure for large-scale model training. In this hands-on role, you will design systems, work closely with researchers, and optimize training processes. Candidates should have strong software engineering skills and experience with JAX or PyTorch. Join a dynamic team at the forefront of machine learning and contribute to core training code and systems.