Hybrid ML Infra Engineer for Scalable LLM Training

Harnham

United States

Hybrid

USD 180,000 - 240,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Harnham is partnering with an early-stage AI lab to recruit a senior ML infrastructure engineer. You will scale workloads across large GPU clusters and work on reducing training time and costs while building robust tooling used by researchers.

You will join a small, senior team with strong ownership from first build to production, and enjoy hybrid options in San Francisco or New York, with remote consideration for the right candidate.

Qualifications

  • 5+ years building ML systems in production.
  • Distributed training or large-scale ML infrastructure experience.
  • Proven track record shipping infrastructure used by other teams.
  • Python, plus PyTorch or JAX.

Responsibilities

  • Scale workloads across large GPU clusters.
  • Cut the time and cost of training and running models.
  • Monitor and debug for large training runs.
  • Evaluation tooling for large language models.

Skills

Distributed ML systems
Python
PyTorch or JAX
Production deployment

Education

Master’s or PhD in ML/CS

Job description

Harnham is partnering with an early-stage AI lab to recruit a senior ML infrastructure engineer. You will scale workloads across large GPU clusters and work on reducing training time and costs while building robust tooling used by researchers.

You will join a small, senior team with strong ownership from first build to production, and enjoy hybrid options in San Francisco or New York, with remote consideration for the right candidate.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Infra Engineer: Scale Training & Inference (Hybrid)
ML Infra Engineer: Scale Training & Inference (Hybrid)

Lattice, Inc. • San Francisco (CA)

Hybrid
USD 200,000 - 280,000
Competitive salary
Premium health, dental, and vision insurance
Unlimited PTO
+2
ML Infra Engineer: Scale & Optimize Large-Scale Training
ML Infra Engineer: Scale & Optimize Large-Scale Training

Physical Intelligence • San Francisco (CA)

On-site
USD 180,000 - 240,000
ML Infrastructure Engineer
ML Infrastructure Engineer

Lattice, Inc. • San Francisco (CA)

On-site
USD 200,000 - 280,000
Competitive salary
Premium health, dental, and vision insurance
Unlimited PTO
+2
Hybrid Security Infrastructure Engineer — AI Cloud & ML
Hybrid Security Infrastructure Engineer — AI Cloud & ML

Higgsfield Inc. • San Francisco (CA)

Hybrid
USD 165,000 - 187,000
Stock options
Hybrid work model
Competitive compensation
ML Infrastructure Engineer: Scale Large-Scale Training
ML Infrastructure Engineer: Scale Large-Scale Training

Goliath Partners Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
ML Infrastructure Engineer
ML Infrastructure Engineer

Objective Partners • San Francisco (CA)

On-site
USD 180,000 - 250,000
Full medical, dental, vision coverage
Flexible PTO
Daily catered lunches
+1
Staff AI Infrastructure Engineer – Scalable ML Platforms
Staff AI Infrastructure Engineer – Scalable ML Platforms

LinkedIn • Mountain View (CA)

Hybrid
USD 175,000 - 287,000
AI/ML Engineer – End-to-End Agents & LLMs (Hybrid)
AI/ML Engineer – End-to-End Agents & LLMs (Hybrid)

Harnham • California

Hybrid
USD 315,000 - 385,000
Hybrid AI Engineer: Production ML & LLMs
Hybrid AI Engineer: Production ML & LLMs

Writer • United States

Hybrid
USD 140,000 - 210,000
Health plans
Parental leave
Hybrid culture
+5
ML Infra Tech Lead: Scalable Training & Inference
ML Infra Tech Lead: Scalable Training & Inference

Reducto • San Francisco (CA)

On-site
USD 180,000 - 260,000
Unlimited PTO
Daily Lunch
Commuter Reimbursement
+3