Staff ML Infrastructure Engineer – Scalable AI Systems

Waymo LLC; New York (NY); On-site; USD 251,000 - 310,000; Full time

Benefits offered by this job

Bonus program

Equity incentives

Benefits program

Job summary

Waymo LLC is seeking a senior ML systems engineer/researcher to lead the design and deployment of scalable ML infrastructure for the DUE team. You will drive end-to-end ML pipelines from data collection to production serving and collaborate across teams to align technical deliverables with product goals.

The role requires strong Python/C++ coding, experience with JAX/TensorFlow/PyTorch, and a track record of leading complex ML projects in dynamic environments.

Qualifications

• B.S. in CS, ML, or related field, or equivalent practical experience.
• 7+ years of hands-on experience building machine learning systems.
• Experience designing, scaling, training, deploying, and optimizing large-scale ML systems.
• Strong coding experience in Python and/or C++.
• Experience with ML frameworks such as JAX, TensorFlow, or PyTorch.

Responsibilities

• Lead design and development of ML infrastructure for DUE models from data to training to production serving.
• Design and scale distributed systems for large-scale dataset generation, model training, and evaluation.
• Own the reliability, efficiency, and observability of production ML serving, including accelerator capacity planning and performance optimization.
• Keep offline evaluation and production inference consistent, so the models we evaluate are the models we serve.
• Drive technical direction for the team, guide architectural decisions, and mentor engineers.

Skills

Python

C++

ML frameworks

Distributed systems

Leadership

Education

B.S. in CS/ML/related field

M.S./Ph.D. preferred

Tools

JAX

TensorFlow

PyTorch

Job description

Waymo LLC is seeking a senior ML systems engineer/researcher to lead the design and deployment of scalable ML infrastructure for the DUE team. You will drive end-to-end ML pipelines from data collection to production serving and collaborate across teams to align technical deliverables with product goals.

The role requires strong Python/C++ coding, experience with JAX/TensorFlow/PyTorch, and a track record of leading complex ML projects in dynamic environments.