Senior Staff ML Infrastructure Architect – Cloud

Google; Town of Montana (WI); On-site; USD 207,000 - 300,000; Full time

Job summary

Google seeks a Senior Staff Software Engineer for Gemini to design and scale large-scale distributed ML infrastructure, accelerating AI adoption on Google Cloud Platform. You will drive core infra components and quality gates, enabling rapid, reliable AI capabilities across Gemini and GCP.

The role emphasizes leadership, collaboration across teams, and delivering robust, scalable systems while mentoring engineers and shaping technical direction in a fast-moving environment.

Qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing and launching software products, and 3 years of experience with software design and architecture.
• 5 years of experience with ML design and ML infrastructure (e.g., model deployment, evaluation, data processing).
• Experience integrating generative AI tools or LLM interfaces into workflows.

Responsibilities

• Design, build, and scale large-scale distributed ML infrastructure and tooling.
• Lead the development of advanced AI quality components and evaluation workflows.
• Lead robust software design and automated testing practices and on-call rotations.
• Coach and mentor engineers and foster a high-performing team culture.

Skills

Software development

Software testing

Software architecture

ML engineering

Generative AI integration

Education

Bachelor's degree or equivalent practical experience

Master's degree or PhD in Engineering/CS or related field

Job description

Google seeks a Senior Staff Software Engineer for Gemini to design and scale large-scale distributed ML infrastructure, accelerating AI adoption on Google Cloud Platform. You will drive core infra components and quality gates, enabling rapid, reliable AI capabilities across Gemini and GCP.

The role emphasizes leadership, collaboration across teams, and delivering robust, scalable systems while mentoring engineers and shaping technical direction in a fast-moving environment.