Lead ML Infra Architect for Billion-Parameter Systems

TikTok Inc.

Seattle (WA)

On-site

USD 198,000 - 416,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

TikTok USDS Joint Venture LLC in Seattle seeks a Senior ML Engineer to lead large-scale distributed training and inferencing platforms for recommendations and search. On-site role with a fully in-person schedule, up to 5 days a week, focusing on scalable architectures and low-latency serving.

The candidate will partner with ML researchers and data platforms to deliver high-performance systems, mentor engineers, and drive architecture decisions across multi-GPU clusters.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical discipline.

Responsibilities

  • Drive the technical roadmap for large-scale distributed real-time ML training and inference platforms.
  • Architect and scale multi-node distributed training systems with 3D parallelism.
  • Build and scale low-latency, high-throughput model serving infrastructure.
  • Co-design with Applied ML Research for next-generation Generative Recommendation systems.
  • Design automated fault-detection and checkpointing for multi-thousand GPU clusters.
  • Collaborate with ML researchers and data platform teams on high-throughput data processing.

Skills

Python
C++/Java
Distributed systems
ML infrastructure
PyTorch / TensorFlow
CUDA / GPU memory
LLM training & inference
Troubleshooting
Kubernetes / Slurm

Education

Bachelor’s or Master’s in CS/CS Engineering

Tools

Megatron
DeepSpeed
Kubernetes
Slurm
TensorRT
InfiniBand / RoCE

Job description

TikTok USDS Joint Venture LLC in Seattle seeks a Senior ML Engineer to lead large-scale distributed training and inferencing platforms for recommendations and search. On-site role with a fully in-person schedule, up to 5 days a week, focusing on scalable architectures and low-latency serving.

The candidate will partner with ML researchers and data platforms to deliver high-performance systems, mentor engineers, and drive architecture decisions across multi-GPU clusters.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Infra Engineer: Real-Time Recommendation & Search
ML Infra Engineer: Real-Time Recommendation & Search

TikTok Inc. • Seattle (WA)

On-site
USD 130,000 - 246,000
Medical, dental, vision insurance
401(k) with company match
Paid parental leave
ML Infra Engineer, Real-Time Recommendations (In-Person)
ML Infra Engineer, Real-Time Recommendations (In-Person)

TikTok Economic Impact • Seattle (WA)

On-site
USD 180,000 - 240,000
ML Infra Engineer: Scalable Training & Real-Time Inference
ML Infra Engineer: Scalable Training & Real-Time Inference

TikTok Economic Impact • San Jose (CA)

On-site
USD 140,000 - 200,000
ML Engineer, Real-Time Recommendations (Onsite)
ML Engineer, Real-Time Recommendations (Onsite)

TikTok USDS Joint Venture LLC • San Jose (CA)

On-site
USD 123,000 - 259,000
Medical, dental, and vision coverage
401(k) with company match
Parental leave
+6
ML Infrastructure Engineer: Build Global ML Systems
ML Infrastructure Engineer: Build Global ML Systems

TikTok Inc. • San Jose (CA)

On-site
USD 150,000 - 360,000
Health insurance
Dental insurance
Vision insurance
+6
ML Engineer – Recommender & Search Systems (Impactful)
ML Engineer – Recommender & Search Systems (Impactful)

TikTok Inc. • Seattle (WA)

On-site
USD 100,000 - 178,000
Medical Insurance
401(k) Match
Paid Leave
Associate ML Engineer, Scalable Recommendations
Associate ML Engineer, Scalable Recommendations

TikTok Inc. • San Jose (CA)

On-site
USD 123,000 - 259,000
ML Engineer, Real-Time Large-Scale Recommendations
ML Engineer, Real-Time Large-Scale Recommendations

TikTok Inc. • San Jose (CA)

On-site
USD 123,000 - 259,000
ML Engineer (PhD Grad) — Recommendations & Search Leader
ML Engineer (PhD Grad) — Recommendations & Search Leader

TikTok Economic Impact • San Jose (CA)

On-site
USD 120,000 - 170,000
ML Engineer Graduate: Recommenders, Search & Personalization
ML Engineer Graduate: Recommenders, Search & Personalization

TikTok Inc. • Seattle (WA)

On-site
USD 100,000 - 178,000
Health insurance
401(k) match
Paid parental leave
+6