Senior Technical Lead Manager, ML Runtime & Serving

Neura Market; Mountain View (CA); Hybrid; USD 251,000 - 310,000; Full time

Benefits offered by this job

Bonus program

Equity incentive plan

Benefits program

Job summary

Waymo is seeking a Senior Technical Lead Manager to guide the technical vision of our core ML infrastructure and mentor a team of six engineers. You will architect scalable ML runtime systems for edge vehicles and offboard data centers, balancing latency and throughput across two domains.

The role involves transitioning workloads to a JAX-native runtime, extending ML compilers/runtimes, and collaborating with ML researchers to drive hardware-aware optimizations.

Qualifications

• 8+ years of professional software engineering experience architecting, building, and scaling complex ML systems.
• Hands-on experience developing distributed backend systems that are low-latency, highly concurrent, and fault-tolerant at scale.
• Strong production programming expertise.

Responsibilities

• Guide the technical vision of our core ML infrastructure while actively growing and managing a high-performing team of senior engineers to deliver Waymo’s next-generation ML ecosystem.
• Architect scalable, high-performance ML runtime systems for edge and cloud deployments.
• Navigate engineering trade-offs to meet real-time latency and memory constraints while supporting high throughput for fleet-scale data.
• Spearhead transition of core ML workloads to a JAX-native runtime architecture and extend underlying ML compilers/runtimes like OpenXLA/PjRT, TensorRT.
• Collaborate with ML researchers to optimize workloads and improve hardware-aware compute efficiency.
• Drive profiling and benchmarking infrastructure to identify bottlenecks across the ML software stack.

Skills

People management

Software engineering

Distributed backend systems

Low-latency systems

Performance optimization

GPU/TPU optimization

Education

B.S. or M.S. in CS/EE/Deep Learning

Tools

OpenXLA

PjRT

TensorRT

ONNX Runtime

TVM

Job description

Waymo is seeking a Senior Technical Lead Manager to guide the technical vision of our core ML infrastructure and mentor a team of six engineers. You will architect scalable ML runtime systems for edge vehicles and offboard data centers, balancing latency and throughput across two domains.

The role involves transitioning workloads to a JAX-native runtime, extending ML compilers/runtimes, and collaborating with ML researchers to drive hardware-aware optimizations.