Staff ML Engineer, Foundation Models & Evaluation

Waymo; San Francisco (CA); Hybrid; USD 238,000 - 302,000; Full time

Benefits offered by this job

Health benefits

401(k) match

PTO 20 days

Sick leave 40h/yr

Maternity leave

Holidays 13 days

Job summary

Waymo is seeking a senior ML engineer to lead end-to-end evaluation systems for its Foundation models. You will oversee the lifecycle from pretraining to reinforcement learning, ensuring quality and safety of embodied AI agents. You will partner across teams to deploy innovations in production and extend large-scale data pipelines.

The role requires a Master’s or PhD in CS, 5+ years in ML engineering, and strong Python/C++ skills, with experience in distributed systems and major ML frameworks.

Qualifications

• Master’s degree or PhD in CS or equivalent practical experience.
• 5+ years of ML engineering and DL with shipped products or publications.
• Experience with large-scale distributed systems.
• Proficient in Python and C/C++.
• Strong analytical and debugging skills.

Responsibilities

• Develop end-to-end evaluation systems and benchmarks for Foundation models.
• Oversee lifecycle from pretraining and SFT to RL for evaluating quality, safety, and realism of embodied AI agents.
• Collaborate across organizations to land disruptive and innovative tech in production.
• Implement and extend large-scale data and evaluation pipelines.

Skills

Python

C/C++

Machine Learning

Distributed systems

Debugging

Analytics

Education

Master's or PhD in CS

Tools

PyTorch

JAX

TensorFlow

Job description

Waymo is seeking a senior ML engineer to lead end-to-end evaluation systems for its Foundation models. You will oversee the lifecycle from pretraining to reinforcement learning, ensuring quality and safety of embodied AI agents. You will partner across teams to deploy innovations in production and extend large-scale data pipelines.

The role requires a Master’s or PhD in CS, 5+ years in ML engineering, and strong Python/C++ skills, with experience in distributed systems and major ML frameworks.