Staff ML Engineer – 3D Perception & Multimodal Models

Waymo; San Francisco (CA); Hybrid; USD 251,000 - 310,000; Full time

Benefits offered by this job

Health, dental, vision insurance

401(k) with company match

20 days PTO per year

Sick time: 40 hours/year

Holidays: 13 paid days

Job summary

Waymo is the world’s leading autonomous driving technology company pursuing scalable, safe mobility. This role is part of the Waymo AI Foundations team, focusing on training and deploying state-of-the-art Multimodal LLMs and World models for 3D perception using camera, LiDAR, and radar data.

The position emphasizes building scalable data pipelines, evaluating perception models, and developing infrastructure for large-scale model distillation and bulk inference.

Qualifications

• PhD or Masters in CS, ML, Robotics with 4+ years post‑doc/industry experience.
• Proficiency in scalable distributed training and data-parallel/sharding approaches.
• Experience with JAX/Flax and TensorFlow or PyTorch.

Responsibilities

• Conduct comprehensive experimentation to train and deploy state-of-the-art Multimodal LLMs and World models.
• Partner with engineering and research teams to deploy new models and create efficient workflows.
• Apply techniques like quantization, pruning, knowledge distillation, and efficient attention mechanisms.

Skills

Reinforcement Learning

Foundation Models

Multi-Modal Learning

Distributed Training

Transformer optimization

Education

PhD or Masters in CS/ML/Robotics

Tools

JAX

Flax

TensorFlow

PyTorch

Job description

Waymo is the world’s leading autonomous driving technology company pursuing scalable, safe mobility. This role is part of the Waymo AI Foundations team, focusing on training and deploying state-of-the-art Multimodal LLMs and World models for 3D perception using camera, LiDAR, and radar data.

The position emphasizes building scalable data pipelines, evaluating perception models, and developing infrastructure for large-scale model distillation and bulk inference.