Technical Lead Manager, Scalable ML Runtime — Edge & Cloud

Waymo; Mountain View (CA); On-site; USD 251,000 - 310,000; Full time

Job summary

Waymo seeks a Senior Technical Lead Manager (TLM) ML Engineer in Mountain View to guide the technical vision of our core ML infrastructure. You will lead a high‑performing team delivering the next‑generation ML ecosystem spanning in‑vehicle inference and cloud serving for foundational models.

You will architect scalable runtime systems for edge and data center deployment, balancing real‑time latency with high throughput, and collaborate with ML researchers to optimize performance across hardware

Qualifications

• 8+ years of professional software engineering experience.
• Experience architecting ML systems and infrastructure.
• People management and team-building experience.
• Strong production programming expertise.
• Experience optimizing ML software for GPUs/TPUs.
• Hands-on experience with distributed backend systems.

Responsibilities

• Guide the technical vision of core ML infrastructure and grow a high-performing team of engineers.
• Architect scalable, high-performance ML runtime systems for edge and data-center domains.
• Navigate trade-offs to meet real-time latency and throughput requirements.
• Advance the transition to a JAX-native runtime architecture and modify ML compilers/runtimes (OpenXLA/PjRT, TensorRT).
• Partner with ML researchers to analyze workloads and unlock performance gains.
• Design profiling/benchmarking infrastructure to identify and fix bottlenecks across the ML stack.

Skills

People management

Production programming

Distributed backend systems

ML systems architecture

GPU/TPU optimization

Education

B.S./M.S. in CS/EE/DL

Tools

OpenXLA/PjRT

TensorRT

ONNX Runtime

Job description

Waymo seeks a Senior Technical Lead Manager (TLM) ML Engineer in Mountain View to guide the technical vision of our core ML infrastructure. You will lead a high‑performing team delivering the next‑generation ML ecosystem spanning in‑vehicle inference and cloud serving for foundational models.

You will architect scalable runtime systems for edge and data center deployment, balancing real‑time latency with high throughput, and collaborate with ML researchers to optimize performance across hardware