Staff ML Engineer - 3D Perception & Multimodal (Hybrid)

Socket.dev; Mountain View (CA); Hybrid; USD 251,000 - 310,000; Full time

Benefits offered by this job

Health, dental, vision

401(k) with company match

Paid time off

Sick time

Maternity leave

Job summary

Waymo is seeking a PhD/MS holder to advance multimodal learning and large-scale model deployment. The role focuses on training state-of-the-art models for 3D perception using camera, LiDAR, and radar data.

Collaboration with cross-functional teams will drive production-grade workflows for continuous training and evaluation. The candidate will optimize training and inference of transformer architectures, explore scaling strategies, and help build robust tools for performance analysis and

Qualifications

• PhD or Masters in Computer Science, ML, Robotics or related field.
• 4+ years of industry or post-doc research in Reinforcement Learning or Foundation Models.
• Experience building scalable model training pipelines.

Responsibilities

• Conduct experiments to train and deploy state-of-the-art Multimodal LLMs and World models for 3D Perception.
• Collaborate with engineering and research teams to deploy models and create workflows for continuous training.
• Develop and optimize techniques like quantization, pruning, distillation, and efficient attention.

Skills

PhD or Masters

4+ years RL/FM research

JAX/Flax

TensorFlow/PyTorch

Distributed training

Education

PhD or MSc in CS/ML/Robotics

Tools

JAX/Flax

TensorFlow

PyTorch

Job description

Waymo is seeking a PhD/MS holder to advance multimodal learning and large-scale model deployment. The role focuses on training state-of-the-art models for 3D perception using camera, LiDAR, and radar data.

Collaboration with cross-functional teams will drive production-grade workflows for continuous training and evaluation. The candidate will optimize training and inference of transformer architectures, explore scaling strategies, and help build robust tools for performance analysis and