ML Infrastructure Lead: Accelerator Fleet Optimization

Google; Sunnyvale (CA); On-site; USD 207,000 - 300,000; Full time

Job summary

Google is seeking an Software Engineering Manager to drive the ML infrastructure strategy and lead multiple teams across ML systems. You will guide core projects, ensure scalable deployment, and mentor engineers delivering high‑impact ML solutions.

You will manage a team of engineers, align with product goals, and oversee cross‑functional collaboration to advance Google's AI and ML capabilities globally.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience with speech/audio, reinforcement learning, ML infrastructure, or related ML field.
• 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, evaluation, data processing).
• 3 years of experience in a technical leadership role.
• 2 years of experience in a people management or team leadership role.

Responsibilities

• Drive technical strategy for large‑scale ML infrastructure development.
• Innovate directions for infrastructure over a 12‑month horizon amid rapidly changing tech.
• Guide sustainable engineering choices for ML systems at scale.
• Drive ML workload efficiencies using scaling, idle suspend, and related tech.
• Lead a team of ~10 engineers to improve efficiency of ML workloads.

Skills

Software development experience

ML experience (speech/audio, RL, ML-in

Education

Bachelor's degree or equivalent practical experience

Master’s degree or PhD in Engineering, CS, or related field

Tools

TPUs

GPUs

Low-level programming

ML compilers and runtimes

Job description

Google is seeking an Software Engineering Manager to drive the ML infrastructure strategy and lead multiple teams across ML systems. You will guide core projects, ensure scalable deployment, and mentor engineers delivering high‑impact ML solutions.

You will manage a team of engineers, align with product goals, and oversee cross‑functional collaboration to advance Google's AI and ML capabilities globally.