Senior ML Training Systems Engineer - Distributed GPU Infra

Baseten; San Francisco (CA); On-site; USD 150,000 - 200,000; Full time

Benefits offered by this job

Competitive compensation, including equity

100% coverage of medical, dental, and vision insurance

Generous PTO policy

Paid parental leave

Company-facilitated 401(k)

Job summary

A leading AI technology company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale training and fine-tuning of foundation models. You will design distributed training systems and optimize GPU utilization while collaborating with cross-functional teams to adapt models efficiently. Ideal candidates have over 5 years of experience in ML infrastructure and a strong background in distributed training frameworks. Competitive compensation and benefits package is offered.

Qualifications

• 5+ years of experience in ML infrastructure or distributed systems.
• Strong expertise in distributed training frameworks like FSDP and DDP.
• Hands-on experience with LLMs or foundation models.

Responsibilities

• Design and maintain the distributed training infrastructure.
• Implement scalable training pipelines for GPU clusters.
• Optimize training performance using techniques like mixed precision.

Skills

Distributed training frameworks

Kubernetes

ML infrastructure

Fine-tuning techniques

GPU optimization

Education

Bachelor’s degree in Computer Science

Tools

Ray

Slurm

Job description

A leading AI technology company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale training and fine-tuning of foundation models. You will design distributed training systems and optimize GPU utilization while collaborating with cross-functional teams to adapt models efficiently. Ideal candidates have over 5 years of experience in ML infrastructure and a strong background in distributed training frameworks. Competitive compensation and benefits package is offered.