Senior ML Infra Architect & AI Systems Lead

Google; Sunnyvale (CA); On-site; USD 207,000 - 300,000; Full time

Job summary

Google is seeking software engineers to join a large-scale distributed ML infrastructure project for Gemini within Google Cloud. You will build and scale the core systems enabling AI adoption across GCP, with opportunities to influence across Google Cloud, DeepMind, and external AI ecosystems.

Responsibilities include designing robust ML tooling, leading quality and evaluation workflows, and mentoring engineers while maintaining high reliability and performance.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
• 5 years of experience with one or more of the following: Speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization in another ML field.
• 5 years of experience with ML design and ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• Experience integrating generative AI tools or LLM interfaces into workflows.

Responsibilities

• Design, build, and scale large-scale distributed ML infrastructure and tooling, including the Simulation and Benchmark platform, to support Gemini post-training and accelerate GCP's AI adoption.
• Lead the development of advanced AI quality components, such as agentic self-improvement, evaluation workflows, Gemini upstreaming, and automated quality gates for first-party skills.
• Lead robust software design and automated testing practices, participate in on-call rotations, and continuously optimize test and production environments for reliability and performance.
• Coach and mentor junior and mid-level engineers, enforce architectural best practices, and actively cultivate a high-performing team culture.

Job description

Google is seeking software engineers to join a large-scale distributed ML infrastructure project for Gemini within Google Cloud. You will build and scale the core systems enabling AI adoption across GCP, with opportunities to influence across Google Cloud, DeepMind, and external AI ecosystems.

Responsibilities include designing robust ML tooling, leading quality and evaluation workflows, and mentoring engineers while maintaining high reliability and performance.