Principal Software Engineer (Perception Pretraining)

Waymo; San Francisco (CA); On-site; USD 332,000 - 421,000; Full time

Benefits offered by this job

Annual bonus program

Equity incentive plan

Generous company benefits

Job summary

A leading autonomous driving technology firm in San Francisco is seeking a Principal Software Engineer for their Perception team. The role involves developing sensor-fusion foundation models that enhance the Waymo Driver's understanding of its environment, and collaborating across teams to optimize model performance. The ideal candidate has over 10 years in ML model development, with extensive experience in technical leadership and proficiency in C++ and Python. Attractive salary range and company benefits included.

Qualifications

• 10+ years of experience in ML model development.
• 4+ years with large-scale vision or multi-modal foundation model development.
• 6+ years in ML-driven production systems.
• 6+ years in a technical leadership role.

Responsibilities

• Develop sensor-fusion foundation models for the Waymo Driver.
• Solve large-scale, multi-stage training of sensor fusion models.
• Develop solutions for frequently updating the models.
• Optimize end-to-end latency from model training to deployment.
• Drive collaborations between Perception and AI Foundation teams.

Skills

Machine Learning model development

C++ proficiency

Python proficiency

Deep learning toolkits (PyTorch, JAX)

Education

Master’s degree or PhD in Computer Science or related field

Job description

Principal Software Engineer, Perception Pretraining

Waymo | Posted Oct 16

Full-time

Unknown

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.
The Perception team at Waymo builds technology that powers the Waymo Driver. Our models allow the Waymo Driver to perceive the world around it, make the right decision for every situation, and deliver people safely to their destinations. We conduct research to address real-world problems and collaborate with research teams at Alphabet. We have access to millions of miles of driving data from a diverse set of sensors, allowing ML practitioners like you to develop multi-modal models and techniques at scale.

You will report to our Director of Engineering in our Perception Organization.

You Will

• Develop sensor-fusion foundation models for the Waymo Driver which can run on the car and provide a temporal-spatial understanding of the surrounding environment
• Solve large-scale, multi-stage training of sensor fusion foundation models with millions of miles of driving data under limited labeling budget partnering with Waymo infrastructure teams
• Develop solutions for frequently updating the models and minimizing time-to-impact from observing to addressing an issue
• Optimize end-to-end latency from model training/update to model deployment
• Drive and accelerate collaborations between Perception teams, between Perception and AI Foundation teams, and partner with the teams working on Planning, Simulation and seek collaboration with Alphabet’s research teams

You Have

• Master’s degree or PhD in Computer Science, Engineering, or a related technical field
• 10+ years of experience in ML model development, and you have 4+ years experience with large-scale vision, video, or multi-modal foundation model development and their integration in end-to-end models
• 6+ years of experience in ML-driven production systems that develops models with large-scale data, training, evaluation, and deployment
• 6+ years of experience in a technical leadership role leading technical teams and setting technical directions in large ML Engineering organizations
• 3+ years of experience with computer vision models, or LLMs, or vision language models
• Proficiency in C++, Python, and modern deep learning toolkits like PyTorch or JAX
• Passion to lead engineering excellence and efficient model development through flywheel automation, while having direct technical experience in model quality development to achieve our goals

We Prefer

• Experience in multi-modal LLM pretraining and fine-tuning, and their infrastructure
• Experience in model distillation techniques and compute optimization
• Familiarity with end-to-end models and their development challenges

Salary Range
$332,000 — $421,000 USD

Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.