Hybrid Staff ML Engineer Perception & Multimodal Models

Waymo; Kirkland (WA); Hybrid; USD 251,000 - 310,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Life insurance

Disability insurance

401(k) plan

Paid time off

Sick leave

Maternity leave

Holiday pay

Job summary

Waymo is seeking a scientist to advance multimodal large language models and world models for 3D perception. You will train and deploy models that fuse camera, LiDAR, and radar data, and work with teams across Waymo to scale training and inference for real-world driving applications.

Ideal candidates hold a PhD or Masters with 4+ years of RL or foundation-model research, and have experience with scalable distributed training, JAX/Flax, and transformer architectures in production environments.

Qualifications

• PhD or Masters in Computer Science, Machine Learning, Robotics, or a similar technical field.
• 4+ years of industry or post‑doc research experience in Reinforcement Learning or Foundation Models.
• Proficiency in implementing model training flows in a scalable, distributed and performant manner.

Responsibilities

• Conduct comprehensive experimentation to train and deploy state-of-the‑art Multimodal LLMs and World models for 3D Perception using sensor data.
• Partner with engineering and research teams to deploy new models and continuous training on fresh data.
• Develop and maintain scalable data pipelines for Training & Eval across multiple sources.
• Design evaluation frameworks for perception models and scalable distillation/inference pipelines.

Skills

Reinforcement Learning

Foundation Models

Multi-Modal learning

Transformer architectures

Distributed training

JAX

Flax

TensorFlow/PyTorch

Education

PhD or Masters in Computer Science, Machine Learning, Robotics

Tools

JAX

Flax

TensorFlow/PyTorch

Job description

Waymo is seeking a scientist to advance multimodal large language models and world models for 3D perception. You will train and deploy models that fuse camera, LiDAR, and radar data, and work with teams across Waymo to scale training and inference for real-world driving applications.

Ideal candidates hold a PhD or Masters with 4+ years of RL or foundation-model research, and have experience with scalable distributed training, JAX/Flax, and transformer architectures in production environments.