ML Efficiency Engineering Manager - AI Rapid Response

Google; United States; On-site; USD 207,000 - 300,000; Full time

Job summary

Google is seeking an Engineering Manager for the ML Efficiency team in Mountain View, CA. You will lead a high‑performing team of AI/ML engineers and guide technical architecture across large-scale pipelines, ensuring delivery of TVPs and efficient workflows.

The role blends technical leadership with people management, overseeing multi-team projects and fiscal planning for a substantial product budget. English proficiency is required for all roles.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 8 years of software development experience.
• 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
• 5 years of experience with one or more of the following: Speech/audio, reinforcement learning, ML infrastructure, or specialization in another ML field.
• 5 years of experience with ML design and ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• Experience integrating generative AI tools or LLM interfaces into workflows.

Responsibilities

• Lead technical pathfinding and system design for the ML Efficiency Hub, driving complex 1-6 month projects and 2-4 week Strike Sprints.
• Design, prototype, and write production C++ and Python code for model distillation, speculative decoding, dynamic batching, and distributed serving systems.
• De-risk ill-defined executive mandates and deliver TVPs within latency, FLOPs, and tokenomics thresholds.
• Evaluate architectural trade-offs and establish Graceful Exit Packages to enable partner teams to achieve autonomy.

Skills

Software development

Software testing

Software architecture

ML design

ML infrastructure

Generative AI integration

Education

Master's degree

PhD

Tools

C++

Python

XManager

BrainServer

SavedModel

Pathways

Job description

Google is seeking an Engineering Manager for the ML Efficiency team in Mountain View, CA. You will lead a high‑performing team of AI/ML engineers and guide technical architecture across large-scale pipelines, ensuring delivery of TVPs and efficient workflows.

The role blends technical leadership with people management, overseeing multi-team projects and fiscal planning for a substantial product budget. English proficiency is required for all roles.