Tech Lead Manager for Scalable LLM Training Platform

Scale AI

San Francisco (CA)

On-site

USD 120,000 - 160,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

A technology company specializing in AI solutions in San Francisco seeks an experienced software engineer. You will build and optimize large-scale ML frameworks, collaborating with cross-functional teams and integrating state-of-the-art technologies. The ideal candidate is passionate about system optimization and has experience with multi-node LLM training. This role offers a chance to influence the future of AI innovation.

Qualifications

  • Passionate about system optimization.
  • Experience with multi-node LLM training and inference.
  • Strong written and verbal communication skills.

Responsibilities

  • Build, profile, and optimize our training and inference framework.
  • Collaborate with ML and research teams.
  • Research and integrate state-of-the-art technologies.

Skills

System optimization
Multi-node LLM training
Large-scale distributed ML systems
Post-training methods (RLHF/RLVR)
Software engineering (CUDA, Pytorch)
Communication skills

Tools

CUDA
Pytorch
Transformers
Flash attention

Job description

A technology company specializing in AI solutions in San Francisco seeks an experienced software engineer. You will build and optimize large-scale ML frameworks, collaborating with cross-functional teams and integrating state-of-the-art technologies. The ideal candidate is passionate about system optimization and has experience with multi-node LLM training. This role offers a chance to influence the future of AI innovation.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Engineer: Agentic LLMs & Scalable AI Systems
Senior AI Engineer: Agentic LLMs & Scalable AI Systems

Harnham • San Francisco (CA)

Hybrid
USD 175,000 - 210,000
Competitive base + equity
Work on cutting-edge AI
High-impact role with ownership
Senior ML Engineer, AI Platform & Products (LLM)
Senior ML Engineer, AI Platform & Products (LLM)

BetterUp • New York (NY)

Hybrid
USD 200,000 - 275,000
LLM Platform Lead — Scalable Training & Inference
LLM Platform Lead — Scalable Training & Inference

Scale AI, Inc. • New York (NY)

On-site
USD 264,000 - 331,000
Comprehensive health, dental and vision coverage
Retirement benefits
Learning and development stipend
+2
Post‑Training ML Engineer: Align & Scale LLMs
Post‑Training ML Engineer: Align & Scale LLMs

Reflection AI • San Francisco (CA)

On-site
USD 90,000 - 130,000
Senior AI Engineer - LLM Platform Lead
Senior AI Engineer - LLM Platform Lead

ZS • South San Francisco (CA)

Hybrid
USD 120,000 - 150,000
Tech Lead for Distributed ML Systems & Training Platform
Tech Lead for Distributed ML Systems & Training Platform

Scale AI • New York (NY), San Francisco (CA)

On-site
USD 275,000 - 350,000
Health, dental, and vision coverage
Retirement benefits
Learning and development stipend
+2
Staff Engineer, LLM Inference & Infra
Staff Engineer, LLM Inference & Infra

Prime Intellect • United States

Hybrid
USD 120,000 - 150,000
Competitive compensation
Flexible work arrangement
Full visa sponsorship
+2
Senior ML Engineer – Enterprise AI & LLM Systems
Senior ML Engineer – Enterprise AI & LLM Systems

Factualiq • Mission (KS)

On-site
USD 110,000 - 130,000
Tech Lead Manager- MLRE, ML Systems
Tech Lead Manager- MLRE, ML Systems

Scale AI • San Francisco (CA)

On-site
USD 120,000 - 160,000
Remote ML Engineering Manager: LLM Serving & Infra
Remote ML Engineering Manager: LLM Serving & Infra

Jobgether • United States

Remote
USD 176,000 - 252,000