Staff AI/ML GenAI Search Architect & Tech Lead

Google LLC; Mountain View (CA); On-site; USD 207,000 - 300,000; Full time

Benefits offered by this job

Equity

Bonus target 20%

Benefits

Job summary

Google is seeking a Staff Software Engineer with a deep background in machine learning and data science to serve as a technical lead in evaluating AI Overviews for factual accuracy and user experience impact. You will set architectural direction and build automated evaluation systems at Search-wide scale, bridging statistics with production software engineering.

You will steer the long-term roadmap for automated evaluation infrastructure, harmonize metrics across teams, and drive production

Qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
• 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 2 years of experience with state of the art GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision).

Responsibilities

• Define the long-term technical roadmap and architectural standards for automated evaluation infrastructure.
• Establish company-wide metric definitions and taxonomies that faithfully capture user behavior and the multidimensional quality of GenAI experiences.
• Lead the design and implementation of highly scalable, production-grade autorater systems.
• Drive advanced statistical methodologies to validate autorater accuracy against production user signals and labeled ground truth.
• Partner with cross-functional teams to integrate statistically significant evaluations into the systems, while mentoring engineers in measurement best practices.

Skills

Software development

ML design

Model deployment

Data processing

Debugging

GenAI concepts

Education

Bachelor's degree or equivalent practical experience

Master’s or PhD in CS/Math/Data Science

Tools

Python

C++

Java

PyTorch

Pandas

Job description

Google is seeking a Staff Software Engineer with a deep background in machine learning and data science to serve as a technical lead in evaluating AI Overviews for factual accuracy and user experience impact. You will set architectural direction and build automated evaluation systems at Search-wide scale, bridging statistics with production software engineering.

You will steer the long-term roadmap for automated evaluation infrastructure, harmonize metrics across teams, and drive production