AI/ML Training Infra Lead — Scale & Reliability

Google; Sunnyvale (CA); On-site; USD 215,000 - 292,000; Full time

Job summary

Google is seeking a Software Engineering Manager in Sunnyvale to lead a high-performing team focused on the design, implementation, and launch of critical scheduling features that support training and inference across Alphabet.

You will guide multiple SWE teams, align with compute infrastructure and SRE, and shape technical roadmaps while balancing long-term health with immediate delivery needs. The role emphasizes leadership and collaboration across product areas.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience leading ML design and optimizing ML infrastructure.
• 5 years of experience with one or more ML subfields (speech/audio, reinforcement learning, or related).
• 3 years of experience in a technical leadership role.
• 2 years of experience in people management or team leadership.

Responsibilities

• Set and communicate team priorities that support the organization’s goals.
• Set expectations with individuals based on level and role; provide feedback and coaching.
• Develop mid-term technical vision and roadmap for multiple teams; evolve roadmap as needed.
• Design, guide, and vet systems designs and write code to solve problems.
• Lead design and implementation of ML solutions; optimize infrastructure and data processing.

Skills

Software development experience

ML design experience

Leadership experience

People management

Education

Bachelor's degree or equivalent practical experience

Master’s degree or PhD (preferred)

Tools

Distributed systems

Job description

Google is seeking a Software Engineering Manager in Sunnyvale to lead a high-performing team focused on the design, implementation, and launch of critical scheduling features that support training and inference across Alphabet.

You will guide multiple SWE teams, align with compute infrastructure and SRE, and shape technical roadmaps while balancing long-term health with immediate delivery needs. The role emphasizes leadership and collaboration across product areas.