Backend Engineer (ML Infra) — Scale AI Training & Inference

Rockstar; San Francisco (CA); On-site; USD 100,000 - 130,000; Full time

Job summary

A dynamic digital product studio is seeking a Backend Software Engineer (ML Infrastructure) to design and build core systems for training and deploying ML models. This early-career role involves collaborating with ML engineers and focuses on distributed training pipelines and cloud-native infrastructure. The ideal candidate has backend engineering experience, strong foundations in distributed systems, and is comfortable working in Python or Go. The position offers an exciting opportunity to work on real ML infrastructure in a fast-paced environment in San Francisco.

Qualifications

• 1–3 years of backend engineering experience in production systems.
• Strong fundamentals in distributed systems, networking, and backend architecture.
• Experience building scalable systems under load.
• Comfortable working in Python and/or Go.
• Excited to work on-site in San Francisco.

Responsibilities

• Design and implement backend systems for large-scale ML workloads.
• Build efficient, fault-tolerant, and observable training pipelines.
• Develop tools for ML engineers to train and deploy models.
• Optimize systems for performance and cost efficiency.
• Implement monitoring and observability for production services.

Skills

Distributed systems

Backend architecture

Python

Go

Kubernetes

Docker

Tools

Ray

vLLM

SGLang

Job description

A dynamic digital product studio is seeking a Backend Software Engineer (ML Infrastructure) to design and build core systems for training and deploying ML models. This early-career role involves collaborating with ML engineers and focuses on distributed training pipelines and cloud-native infrastructure. The ideal candidate has backend engineering experience, strong foundations in distributed systems, and is comfortable working in Python or Go. The position offers an exciting opportunity to work on real ML infrastructure in a fast-paced environment in San Francisco.