Senior ML Platform Engineer — Scalable Inference & Infra

Waymo; California (MO); Hybrid; USD 213,000 - 263,000; Full time

Benefits offered by this job

Discretionary annual bonus

Equity incentive plan

Company benefits program

Job summary

Waymo is seeking a Software Engineer to join the ML Ops team within the ML Platform group. The role focuses on building and maintaining data and ML pipelines that power ML development at Waymo.

In a hybrid role, you will report to the Head of ML Platform and contribute to scalable inference platforms and model hosting solutions across internal and external models. You will collaborate with multiple Waymo teams to improve throughput, reduce costs, and deploy inference solutions for various use

Qualifications

• 5+ years of professional experience in software engineering.
• Experience in programming C++.
• Experience with building highly scalable distributed systems.

Responsibilities

• Develop Waymo's inference platform to be scalable, high throughput, and low latency.
• Work closely with teams across Waymo in hosting both internal and external ML models, including LLMs.
• Improve the efficiency of running inference to increase throughput and save cost.
• Deploy and integrate model inference solutions across use cases such as distillation, eval, dataset generation, active learning, and auto-labeling.

Skills

Software engineering

C++

Distributed systems

Job description

Waymo is seeking a Software Engineer to join the ML Ops team within the ML Platform group. The role focuses on building and maintaining data and ML pipelines that power ML development at Waymo.

In a hybrid role, you will report to the Head of ML Platform and contribute to scalable inference platforms and model hosting solutions across internal and external models. You will collaborate with multiple Waymo teams to improve throughput, reduce costs, and deploy inference solutions for various use