Staff Software Engineer, Eval Infra TL, Quality Platform, Gemini Cloud Operator, Agentic AI

Google LLC

Sunnyvale (CA)

On-site

USD 207,000 - 300,000

Full time

9 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Google LLC is hiring a software engineer to lead the Quality Platform and its scalable ML infrastructure, shaping evaluation pipelines for Gemini cloud ops. You will drive end-to-end design, performance, and reliability across complex, distributed systems.

The role requires leadership in ML and AI, experience with large-scale systems, and proficiency in Generative AI lifecycles and evaluation tooling. This position is based in Sunnyvale, CA, with competitive compensation and benefits.

Qualifications

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of software engineering leadership in ML Infrastructure or AI.
  • 5 years of experience with large-scale distributed systems.
  • Experience with Generative AI lifecycle including Agent frameworks, RAG, prompt engineering or evaluation systems.

Responsibilities

  • Serve as overall Tech Lead for the Quality Platform and scalable ML infrastructure.
  • Lead mission-critical efforts including Gemini simulation and eval infrastructure.
  • Establish and scale testing and reliability frameworks for high-quality, scalable platforms.
  • Collaborate across teams to translate complex requirements into robust engineering solutions.
  • Mentor engineers and drive production stability through on-call rotations.

Skills

Software development
Leadership
ML Infrastructure
Generative AI
Distributed systems
Agent frameworks
RAG
Prompt engineering
Model evaluation

Education

Bachelor's degree or equivalent practical experience
Master's or PhD in Engineering/CS

Job description

Minimum qualifications
  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of software engineering leadership in ML Infrastructure, ML, or product-focused AI.
  • 5 years of experience with large-scale distributed systems.
  • Experience with Generative AI lifecycle, including Agent frameworks or protocols (e.g., MCP, A2A), RAG, prompt engineering, or model evaluation systems.
Preferred qualifications
  • Master's degree or PhD in Engineering, Computer Science, or a related technical field.
  • 8 years of experience with data structures and algorithms.
  • 3 years of experience in a technical leadership role leading project teams and setting technical direction.
  • 3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.
  • Experience architecting or contributing to simulation frameworks, evaluation infrastructure, or enterprise quality platforms.
About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Gemini Cloud Assist is designed to simplify how customers learn, design, deploy, and operate their services. Our vision is to establish an intelligent AI agent as the primary interface for cloud operations, integrating seamlessly across the Cloud Console, IDEs, and other developer surfaces. This role focuses on the Quality Flywheel, a foundational platform at the core of our AI quality strategy. You will build the end-to-end system that drives our agent's continuous, automated improvement. This involves analyzing user interactions, implementing real-time evaluations to detect successes and failures, generating high-quality evaluation data, and creating feedback loops that drive model self-improvement and fine-tuning. Your work will directly contribute to making Gemini the leading model for cloud operational tasks, ensuring it delivers exceptional performance and reliability for our customers.

Pay

Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits

Learn more about benefits at Google.

Responsibilities
  • Serve as overall Tech Lead for the Quality Platform, architecting core Quality Flywheel components and scalable ML infrastructure.
  • Lead mission-critical efforts, including Gemini simulation, deep system integrations, eval generation, and next-gen eval infrastructure.
  • Establish and scale testing and reliability frameworks to ensure high platform quality and performance at scale.
  • Collaborate across teams to translate complex, ambiguous requirements into simple, robust engineering solutions.
  • Mentor engineers, strengthen team culture, and drive production stability through on-call rotations and environment improvements.

Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google's EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineering Manager, Eval Infra, Quality Platform, Gemini Cloud Operator, Agentic AI
Software Engineering Manager, Eval Infra, Quality Platform, Gemini Cloud Operator, Agentic AI

Google LLC • Sunnyvale (CA)

On-site
USD 207,000 - 300,000
Software Engineer, Gemini App Skills Platform, DeepMind
Software Engineer, Gemini App Skills Platform, DeepMind

DeepMind Technologies Limited • Mountain View (CA)

On-site
USD 174,000 - 252,000
Software Engineer, Gemini App Skills Platform, DeepMind
Software Engineer, Gemini App Skills Platform, DeepMind

DeepMind • Mountain View (CA)

On-site
USD 174,000 - 252,000
Staff Software Engineer, AI Data Safety
Staff Software Engineer, AI Data Safety

Google LLC • Mountain View (CA)

On-site
USD 207,000 - 300,000
Senior Software Engineer, ML Performance, GenAI, DeepMind
Senior Software Engineer, ML Performance, GenAI, DeepMind

Google DeepMind • Mountain View (CA)

On-site
USD 174,000 - 252,000
Senior Software Engineer, AI/ML NLP, Deep Learning, Search Infrastructure
Senior Software Engineer, AI/ML NLP, Deep Learning, Search Infrastructure

Google LLC • Mountain View (CA)

On-site
USD 174,000 - 252,000
Senior Software ML Engineer, AI/ML GenAI, Gemini Enterprise
Senior Software ML Engineer, AI/ML GenAI, Gemini Enterprise

Google LLC • Sunnyvale (CA)

On-site
USD 174,000 - 252,000
Equity
Benefits
Staff Software Engineer, Agent Quality
Staff Software Engineer, Agent Quality

Google LLC • Sunnyvale (CA)

On-site
USD 207,000 - 300,000
Software Engineer, Gemini App, Growth and Discovery
Software Engineer, Gemini App, Growth and Discovery

Google LLC • Mountain View (CA)

On-site
USD 207,000 - 300,000
Staff Software ML Engineer, Search Discover Feed Recommendation
Staff Software ML Engineer, Search Discover Feed Recommendation

Google LLC • Mountain View (CA)

On-site
USD 207,000 - 300,000