Software Engineer, ML Training Platform (Remote)

Baseten

United States

Remote

USD 180,000 - 230,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Remote-first culture
In-person team summits three times a <

Job summary

Baseten is seeking a software engineer to ship developer-focused ML infrastructure. You will design and implement features across API, backend, and infra, enabling multi-node training, checkpointing, and seamless deployment of checkpoints to inference servers.

You will collaborate with research engineers to apply state-of-the-art training techniques, iterate rapidly, and deliver user-friendly tooling. You’ll work from a remote-friendly setup, with opportunities to join in-person summits and

Qualifications

  • 5+ years of building software applications
  • Experience building developer tooling or infrastructure products
  • Excellent written and verbal communication
  • Deep knowledge of web stack, databases, and distributed systems
  • Interest in ML/AI infrastructure and willingness to learn

Responsibilities

  • Own features from conception to MVP and GA
  • Architect solutions across API, backend, database, infra, and frontend
  • Fine-tune models to understand user workflows
  • Collaborate with research engineers on training techniques
  • Improve training DX and pipeline reliability
  • Fix bugs and respond to customer issues with urgency

Skills

5+ years experience
Developer tooling/infrastructure
Strong communication
Web stack & distributed systems
ML/AI infrastructure interest
Product sense for dev tools
Model training methods (Fine-Tuning,RL
Open source training stacks
Distributed training (DeepSpeed)
Frontend fluency

Tools

NCCL
PyTorch
Megatron
DeepSpeed
HF Trainer

Job description

Baseten is seeking a software engineer to ship developer-focused ML infrastructure. You will design and implement features across API, backend, and infra, enabling multi-node training, checkpointing, and seamless deployment of checkpoints to inference servers.

You will collaborate with research engineers to apply state-of-the-art training techniques, iterate rapidly, and deliver user-friendly tooling. You’ll work from a remote-friendly setup, with opportunities to join in-person summits and

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Software Engineer - Training Infrastructure
Software Engineer - Training Infrastructure

The Consensus • New York (NY)

On-site
USD 110,000 - 150,000
Competitive compensation, including equity
100% coverage of medical, dental, and vision insurance
Flexible PTO policy including company-wide Winter Break
+4
Senior Remote ML Infrastructure Engineer
Senior Remote ML Infrastructure Engineer

BairesDev • Peru (IL)

On-site
USD 120,000 - 170,000
Remote work
Payment in USD
Home setup provided
+3
ML Training Infrastructure Engineer — Equity
ML Training Infrastructure Engineer — Equity

Baseten • United States

Remote
USD 180,000 - 240,000
Equity
Full medical/dental/vision coverage
Software Engineer - Training Infrastructure
Software Engineer - Training Infrastructure

Baseten • San Francisco (CA)

On-site
USD 165,000 - 330,000
Competitive compensation, including meaningful equity
100% coverage of medical, dental, and vision insurance
Flexible PTO policy and paid parental leave
+1
Software Engineer - Training Product
Software Engineer - Training Product

Baseten • San Francisco (CA)

On-site
USD 110,000 - 150,000
Competitive compensation, including equity.
100% medical coverage.
Generous PTO policy.
+1
ML Inference Infrastructure Engineer
ML Inference Infrastructure Engineer

Baseten • United States

Remote
USD 120,000 - 190,000
Equity
Medical coverage for employee and dep.
Flexible PTO including Winter Break
+3
Senior ML Training Infrastructure Engineer
Senior ML Training Infrastructure Engineer

Baseten • San Francisco (CA)

On-site
USD 165,000 - 330,000
Software Engineer (Training Infrastructure)
Software Engineer (Training Infrastructure)

BaseTen • New York (NY), San Francisco (CA)

Hybrid
USD 150,000 - 200,000
Competitive compensation, including equity
100% coverage of medical, dental, and vision insurance
Generous PTO policy
+2
Software Engineer - Training Product
Software Engineer - Training Product

The Consensus • New York (NY)

On-site
USD 120,000 - 150,000
Competitive compensation with equity
100% medical, dental, and vision insurance
Flexible PTO including a Winter Break
Software Engineer (Training Product)
Software Engineer (Training Product)

Baseten • United States

Remote
USD 180,000 - 230,000
Remote-first culture
In-person team summits three times a <