ML Engineer: Build Scalable AI Training Pipelines

Inference

San Francisco (CA)

Hybrid

USD 220,000 - 320,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Comprehensive benefits
Large compute budget

Job summary

Inference.net trains and hosts specialized language models for companies seeking frontier-quality AI at a fraction of the cost. The team builds end-to-end pipelines for distillation, training, evaluation, and planet-scale hosting in a high-impact environment.

The role focuses on building core ML systems, leading training projects, and applying cutting-edge techniques to production. You’ll work closely with a small, experienced team in SF and contribute to customer-facing model delivery.

Qualifications

  • 2+ years of experience training AI models using PyTorch.
  • Adept at SFT or RL with LLMs.
  • Strong understanding of transformer architectures.

Responsibilities

  • Lead projects from data intake through the full training pipeline, including processing, cleaning, and preparing datasets for model training.
  • Build and maintain data processing pipelines for aggregating, transforming, and validating training data.
  • Create dashboards and visualization tools to display training metrics, data quality, and model performance.
  • Train models using our internal frameworks and iterate based on evaluation results.
  • Develop robust benchmarks and evaluation frameworks that ensure custom models match or exceed frontier performance.
  • Build systems to automate portions of the training workflow, reducing manual intervention and improving consistency.
  • Take research features and ship them into production settings.
  • Apply the latest techniques in SFT, RL, and model optimization to improve training quality and efficiency.
  • Collaborate with infrastructure engineers to scale training across our GPU fleet.
  • Deeply understand customer use cases to inform training strategies and surface edge cases.

Skills

PyTorch
SFT/RL for LLMs
Transformer models
Production ML
ETL pipelines

Tools

Hugging Face Transformers
DeepSpeed
Axolotl

Job description

Inference.net trains and hosts specialized language models for companies seeking frontier-quality AI at a fraction of the cost. The team builds end-to-end pipelines for distillation, training, evaluation, and planet-scale hosting in a high-impact environment.

The role focuses on building core ML systems, leading training projects, and applying cutting-edge techniques to production. You’ll work closely with a small, experienced team in SF and contribute to customer-facing model delivery.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Production ML Engineer Lead - Pipelines & Inference Scale
Production ML Engineer Lead - Pipelines & Inference Scale

Clera Labs, Inc. • San Francisco (CA)

On-site
USD 130,000 - 160,000
Backend AI Engineer: Scalable Inference & APIs
Backend AI Engineer: Scalable Inference & APIs

USA Tech Recruit • San Francisco (CA)

On-site
USD 150,000 - 210,000
ML Infra Engineer - Scalable Training & Inference (Equity)
ML Infra Engineer - Scalable Training & Inference (Equity)

Snap Inc. • Palo Alto (CA)

On-site
USD 209,000 - 313,000
Production ML Engineer — Scalable Deep Learning Pipelines
Production ML Engineer — Scalable Deep Learning Pipelines

Hive • San Francisco (CA)

On-site
USD 120,000 - 180,000
ML Systems Engineer: Training & Inference Infra
ML Systems Engineer: Training & Inference Infra

NextToken AI Inc. • Mountain View (CA)

On-site
USD 180,000 - 250,000
Infrastructure Inference Engineer for Scalable AI
Infrastructure Inference Engineer for Scalable AI

Bison • San Francisco (CA)

On-site
USD 400,000 - 500,000
Health, dental, and vision benefits
Unlimited PTO
Paid parental leave
+1
ML Infrastructure Engineer — Build Scalable AI Pipelines
ML Infrastructure Engineer — Build Scalable AI Pipelines

AppLovin • Palo Alto (CA)

On-site
USD 119,000 - 179,000
Medical, Dental, Vision Insurance
401(k) Retirement Plan
Unlimited Discretionary Time Off
+2
Applied Machine Learning Engineer
Applied Machine Learning Engineer

Inference • San Francisco (CA)

Hybrid
USD 220,000 - 320,000
Equity
Comprehensive benefits
Large compute budget
AI Training Infrastructure Engineer for Scalable ML
AI Training Infrastructure Engineer for Scalable ML

Skild AI • San Mateo (CA)

On-site
USD 100,000 - 300,000
ML Platform Engineer: Build Scalable AI Pipelines
ML Platform Engineer: Build Scalable AI Pipelines

UniversalAGI, Inc. • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Competitive equity upside
In‑person, 5 days in office
Immigration support