Senior ML Infra Lead - Large-Scale Model Optimization

Neura Market; Mountain View (CA); Hybrid; USD 298,000 - 378,000; Full time

Job summary

Waymo is seeking a Senior Tech Lead for ML Infrastructure to drive efficient deployment of large-scale models across diverse hardware. You will work across data engineering, model development, and on-device deployment to enable scalable AI solutions.

You will guide optimization efforts for billions-parameter models, develop performance tooling, and coordinate multiple teams toward high performance and reliability in Waymo’s autonomous driving stack.

Qualifications

• 10+ years of professional software engineering with 5+ years in ML infrastructure
• Experienced using ML accelerator profiling tools to uncover bottlenecks
• Deep understanding of state-of-the-art ML models and architectures

Responsibilities

• Take ownership of improving model efficiency across platforms and drive model system codesign with measurable deliverables
• Develop tooling for performance analysis and optimizations in distributed training/inference environments
• Lead cross-team efforts to integrate data generation, model development, and deployment pipelines
• Mentor junior engineers and manage IC performance for a mid-size team

Skills

ML infrastructure

Cross-functional leadership

Strong communication

Education

Master's or PhD in CS/Engineering

Tools

DeepSpeed

PyTorch

TensorFlow

JAX

Job description

Waymo is seeking a Senior Tech Lead for ML Infrastructure to drive efficient deployment of large-scale models across diverse hardware. You will work across data engineering, model development, and on-device deployment to enable scalable AI solutions.

You will guide optimization efforts for billions-parameter models, develop performance tooling, and coordinate multiple teams toward high performance and reliability in Waymo’s autonomous driving stack.