Senior ML Engineer - 3D Perception & Autonomous Driving

Neura Market; Mountain View (CA); Hybrid; USD 213,000 - 263,000; Full time

Benefits offered by this job

Discretionary annual bonus

Equity incentive plan

Company benefits program

Job summary

Waymo is seeking a highly skilled researcher to advance multimodal 3D perception. You will develop and train world models and multimodal LLMs, using camera, LiDAR, and radar data to improve autonomous driving capabilities.

The role involves scalable training, deployment to production, and collaboration with cross‑functional teams in a hybrid work setting. A PhD or Master’s in a relevant field with 2+ years of RL or foundation models experience is required.

Qualifications

• PhD or Masters in Computer Science, Machine Learning, Robotics, or a similar technical field, with 2+ years of industry or post‑doc research experience in Reinforcement Learning or Foundation Models.
• Proficiency in implementing model training flows in a scalable, distributed and performant manner such as Data parallel, FSDP and other sharding approaches.
• Willingness to work with the complexity of globally distributed inference infrastructure.

Responsibilities

• Conduct comprehensive experimentation to train and deploy state-of-the‑art Multimodal LLMs and World models to perform 3D Perception using sensor information from Camera, LiDAR and Radar.
• Write high quality code, unit tests, and documentation
• Collaborate effectively with partner and customer teams to deploy models to production
• Develop and maintain scalable data pipelines for Training & Eval to process data from multiple sources.
• Design and implement evaluation frameworks for perception models.
• Implement efficient training & inference optimization methods to maximize throughput
• Hands‑on experience with Transformer architectures with in‑depth knowledge on training ablations.

Skills

Transformer architectures

Distributed training

3D Perception

Data pipelines

Evaluation frameworks

Training ablations

Education

PhD or Masters in CS/ML/Robotics

Tools

PyTorch

Job description

Waymo is seeking a highly skilled researcher to advance multimodal 3D perception. You will develop and train world models and multimodal LLMs, using camera, LiDAR, and radar data to improve autonomous driving capabilities.

The role involves scalable training, deployment to production, and collaboration with cross‑functional teams in a hybrid work setting. A PhD or Master’s in a relevant field with 2+ years of RL or foundation models experience is required.