Principal Software Engineer, Perception Pretraining

Waymo; California (MO); Hybrid; USD 349,000 - 431,000; Full time

Benefits offered by this job

Discretionary annual bonus

Equity incentive plan

Generous benefits program

Job summary

Waymo is seeking a senior ML engineer to lead the Perception team's development of sensor-fusion foundation models for the Waymo Driver. You will drive large-scale training with millions of miles of driving data and work to minimize time-to-impact from observation to action.

You will report to the Director of Engineering in Perception and bring 10+ years of ML development, 6+ years of leadership, and strong C++, Python, PyTorch/JAX expertise to a hybrid work environment.

Qualifications

• Master's degree or PhD in Computer Science, Engineering, or a related technical field.
• 10+ years of experience in ML model development.
• 6+ years leading ML engineering teams.

Responsibilities

• Develop sensor-fusion foundation models for the Waymo Driver.
• Solve large-scale, multi-stage training with millions of miles of data.
• Optimize end-to-end latency from training to deployment.
• Foster collaboration across Perception, AI Foundation, Planning, and Alphabet research teams.

Skills

C++

Python

PyTorch

JAX

Education

Master's or PhD in CS/Engineering

Tools

PyTorch

JAX

Job description

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

Waymo’s Perception team at Waymo builds technology that powers the Waymo Driver. Our models allow the Waymo Driver to perceive the world around it, make the right decision for every situation, and deliver people safely to their destinations. We conduct research to address real-world problems and collaborate with research teams at Alphabet. We have access to millions of miles of driving data from a diverse set of sensors, allowing ML practitioners like you to develop multi-modal models and techniques at scale.

You will report to our Director of Engineering in our Perception Organization.

You will:

• Develop sensor-fusion foundation models for the Waymo Driver which can run on the car and provide a temporal-spatial understanding of the surrounding environment
• Solve large-scale, multi-stage training of sensor fusion foundation models with millions of miles of driving data under limited labeling budget partnering with Waymo infrastructure teams
• Develop solutions for frequently updating the models and minimizing time-to-impact from observing to addressing an issue
• Optimize end-to-end latency from model training/update to model deployment
• Drive and accelerate collaborations between Perception teams, between Perception and AI Foundation teams, and partner with the teams working on Planning, Simulation and seek collaboration with Alphabet's research teams

You have:

• Master's degree or PhD in Computer Science, Engineering, or a related technical field
• 10+ years of experience in ML model development, and you have 4+ years experience with large-scale vision, video, or multi-modal foundation model development and their integration in end-to-end models
• 6+ years of experience in ML-driven production systems that develops models with large-scale data, training, evaluation, and deployment
• 6+ years of experience in a technical leadership role leading technical teams and setting technical directions in large ML Engineering organizations
• 3+ years of experience with computer vision models, or LLMs, or vision language models
• Proficiency in C++, Python, and modern deep learning toolkits like PyTorch or JAX
• Passion to lead engineering excellence and efficient model development through flywheel automation, while having direct technical experience in model quality development to achieve our goals

We prefer:

• Experience in multi-modal LLM pretraining and fine-tuning, and their infrastructure
• Experience in model distillation techniques and compute optimization
• Familiarity with end-to-end models and their development challenges

#LI-Hybrid

The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.

Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.

Salary Range

$349,000—$431,000 USD