Senior ML Engineer — 3D Perception & Multimodal AI

Socket.dev; Mountain View (CA); Hybrid; USD 213,000 - 263,000; Full time

Benefits offered by this job

Health insurance

401(k) with company match

Paid time off

Job summary

Waymo is seeking a research scientist to advance multimodal LLMs for 3D perception. You will train and deploy state-of-the-art models using camera, LiDAR, and radar data, and collaborate with teams to productionize solutions.

Role emphasizes scalable data pipelines, robust evaluation, and efficient training/inference optimization. Candidates should have PhD or Masters in CS/ML/Robotics with 2+ years RL or foundation models, and experience with transformer architectures.

Qualifications

• PhD or Masters in Computer Science, Machine Learning, Robotics, or a similar technical field, with 2+ years of industry or post-doc research experience in Reinforcement Learning or Foundation Models.
• Proficiency in implementing model training flows in a scalable, distributed and performant manner such as Data parallel, FSDP and other sharding approaches.
• A willingness to work with complexity of globally distributed inference infrastructure.

Responsibilities

• Conduct comprehensive experimentation to train and deploy state-of-the-art Multimodal LLMs and World models to perform 3D Perception using sensor information from Camera, LiDAR and Radar.
• Write high quality code, unit tests, and documentation
• Collaborate effectively with partner and customer teams to deploy models to production
• Develop and maintain scalable data pipelines for Training & Eval to process data from multiple sources.
• Design and implement evaluation frameworks for perception models.
• Implement efficient training & inference optimization methods to maximize throughput
• Hands‑on experience with Transformer architectures with in-depth knowledge on training ablations.

Skills

Distributed training

Transformer models

3D perception

Education

PhD or Master's in CS/ML/Robotics

Job description

Waymo is seeking a research scientist to advance multimodal LLMs for 3D perception. You will train and deploy state-of-the-art models using camera, LiDAR, and radar data, and collaborate with teams to productionize solutions.

Role emphasizes scalable data pipelines, robust evaluation, and efficient training/inference optimization. Candidates should have PhD or Masters in CS/ML/Robotics with 2+ years RL or foundation models, and experience with transformer architectures.