Senior/Staff ML Engineer, 3D/4D World Modeling, Simulation

Waymo; Mountain View (CA); On-site; USD 204,000 - 259,000; Full time

Benefits offered by this job

Discretionary annual bonus program

Equity incentive plan

Generous Company benefits program

Job summary

A leading autonomous driving technology company is seeking a talented ML Engineer to develop 4D world models and generative systems for simulation. Candidates should have extensive experience in machine learning, especially with video generation techniques. This position is based in California and offers a base salary ranging from $204,000 to $259,000.

Qualifications

• 5+ years of experience in ML engineering and applied Deep Learning.
• Proven experience in developing and training large-scale generative models for video generation.
• Strong programming skills in Python with experience in ML frameworks.

Responsibilities

• Lead the design, development and deployment of 4D world models.
• Architect and implement scalable ML pipelines for generative models.
• Mentor and provide technical guidance to other engineers.

Skills

Machine Learning

Deep Learning

3D World Modeling

Python

Education

MS or PhD in Computer Science, Machine Learning, Robotics

Tools

Jax/Flax

PyTorch

TensorFlow

Job description

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

The Simulator Team at Waymo builds state-of-the-art simulations of realistic environments for testing, training, and validation of the Waymo Driver. Our team is a diverse, and collaborative group of machine learning (ML) engineers, software engineers, and ML research engineers. We develop industry-leading simulation solutions using advanced generative and reconstructive ML algorithms, to model the real world, encompassing realistic agents, roads, traffic systems, weather, and the full sensor suite (Camera, Lidar, Radar).

To accelerate the fidelity, scalability, controllability, and richness of our simulations, we are pushing the frontiers of 3D world modeling. We leverage state-of-the-art ML technologies trained on large‑scale datasets to create dynamic and semantically rich virtual worlds, directly impacting the development and validation of the Waymo Driver.

In this role, you will report to a Senior Staff Engineering Manager.

You will:

• Lead the design, development and deployment of cutting‑edge 4D world models and generative systems for ultra‑realistic and controllable sensor and semantics generation for simulation use cases at Waymo.
• Architect and implement scalable and robust ML pipelines for training, evaluating, and deploying large‑scale generative models into our simulation infrastructure, including techniques like model distillation and quantization.
• Build and scale production‑ready video generation techniques (e.g., Diffusion, Flow Matching) to create dynamic and interactive simulation environments.
• Apply Vision Language Models (VLMs) to enhance the semantic understanding and controllability of our world simulation products.
• Partner with world class research teams across Waymo and Alphabet to leverage State‑of‑The‑Art research in 4D world modeling and generative AI into robust, production‑ready solutions.
• Mentor and provide technical guidance to other engineers on the team.

You have:

• MS or PhD in Computer Science, Machine Learning, Robotics, or a related field.
• 5+ years of experience in ML engineering and applied Deep Learning, with a strong portfolio of shipped products or publication record.
• Proven experience in developing and training large‑scale generative models for video generation (e.g., Diffusion models, Flow Matching) or Vision Language Models (VLMs) and their applications.
• Deep expertise in 3D World Modeling or 3D computer vision.
• Familiarity with 3D reconstruction and rendering techniques (e.g., 3D Gaussian Splatting).
• Strong programming skills in Python and experience with ML frameworks such as Jax/Flax, PyTorch or Tensorflow.

We prefer:

• PhD and a strong track record of delivering impactful ML products in 3D generative models, world models, or video generation.
• Experience in simulating sensor data (Camera, Lidar, Radar) and/or semantic scenes.
• Experience with autonomous systems, robotics, or autonomous vehicle simulation.
• Experience in training and optimizing large scale models on GPU/TPU clusters for efficient serving.
• Experience in C++ for production systems.

#LI-Hybrid

The expected base salary range for this full‑time position across US locations is listed below. Actual starting pay will be based on job‑related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.

Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.

Salary Range

$204,000—$259,000 USD