Principal Software Engineer, Perception Pretraining

Waymo; Mountain View (CA); On-site; USD 332,000 - 421,000; Full time

Benefits offered by this job

Annual bonus program

Equity incentive plan

Generous company benefits

Job summary

An autonomous driving technology company is seeking a Senior Machine Learning Engineer to develop advanced sensor-fusion models for their autonomous driving system. The ideal candidate will have a Master's or PhD and extensive experience in ML model development, particularly in large-scale systems. This role involves optimizing model latency and collaborating with various teams to enhance the Waymo Driver. Competitive compensation including annual bonuses and benefits is offered.

Qualifications

• 10+ years of experience in ML model development.
• 4+ years experience with large-scale vision, video or multi-modal foundation model development.
• 6+ years of experience in ML-driven production systems.

Responsibilities

• Develop sensor-fusion foundation models for the Waymo Driver.
• Optimize end-to-end latency from model training to deployment.
• Drive collaborations between Perception teams and partner teams.

Skills

ML model development

C++ proficiency

Python proficiency

Deep learning toolkits

Computer vision models

Education

Master's degree or PhD in Computer Science or related field

Tools

PyTorch

JAX

Job description

Overview

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

The Perception team at Waymo builds technology that powers the Waymo Driver. Our models allow the Waymo Driver to perceive the world around it, make the right decision for every situation, and deliver people safely to their destinations. We conduct research to address real-world problems and collaborate with research teams at Alphabet. We have access to millions of miles of driving data from a diverse set of sensors, allowing ML practitioners like you to develop multi-modal models and techniques at scale.

You will report to our Director of Engineering in our Perception Organization.

Responsibilities

You will:

• Develop sensor-fusion foundation models for the Waymo Driver which can run on the car and provide a temporal-spatial understanding of the surrounding environment
• Solve large-scale, multi-stage training of sensor fusion foundation models with millions of miles of driving data under limited labeling budget partnering with Waymo infrastructure teams
• Develop solutions for frequently updating the models and minimizing time-to-impact from observing to addressing an issue
• Optimize end-to-end latency from model training/update to model deployment
• Drive and accelerate collaborations between Perception teams, between Perception and AI Foundation teams, and partner with the teams working on Planning, Simulation and seek collaboration with Alphabet's research teams

Qualifications

You have:

• Master's degree or PhD in Computer Science, Engineering, or a related technical field
• 10+ years of experience in ML model development, and you have 4+ years experience with large-scale vision, video, or multi-modal foundation model development and their integration in end-to-end models
• 6+ years of experience in ML-driven production systems that develops models with large-scale data, training, evaluation, and deployment
• 6+ years of experience in a technical leadership role leading technical teams and setting technical directions in large ML Engineering organizations
• 3+ years of experience with computer vision models, or LLMs, or vision language models
• Proficiency in C++, Python, and modern deep learning toolkits like PyTorch or JAX
• Passion to lead engineering excellence and efficient model development through flywheel automation, while having direct technical experience in model quality development to achieve our goals

Preferred qualifications

• Experience in multi-modal LLM pretraining and fine-tuning, and their infrastructure
• Experience in model distillation techniques and compute optimization
• Familiarity with end-to-end models and their development challenges

#LI-Hybrid

Compensation and benefits

The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.

Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.

Salary Range

$332,000—$421,000 USD