Senior Software Engineer - AI Quality & Search

Google; New York (NY); On-site; USD 174,000 - 252,000; Full time

Job summary

Google is seeking a Senior Software Engineer, Search AI Rater Quality, to advance AutoRater quality across search-related AI products. The role emphasizes collaboration with Search Platforms, Intelligence, and DeepMind, with emphasis on live events and factuality in multiple verticals.

The candidate should have 5+ years in software development, expertise in information retrieval metrics, and data analysis using SQL, R, or Python. Location options include NY or DC, with in-person interviews.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 5 years of experience with software development in one or more programming languages.
• Experience evaluating search relevance, information retrieval systems, or search quality metrics (e.g., NDCG, precision, recall).
• Experience conducting exploratory data analysis on datasets using programming languages such as SQL, R, or Python.

Responsibilities

• Improve SVI AutoRater capabilities for critical quality dimensions, with a near-term focus on live events factuality and freshness in verticals such as live sports, media analysis, real-time stock quotes, and weather.
• Interface directly with Search Platforms, Search Intelligence, and DeepMind counterparts to improve the quality of shared, horizontal AutoRaters in Search and DeepMind.
• Design and develop new AI-based raters to detect and diagnose quality gaps within AI products in Search and AI Mode.
• Reduce quality iteration cycles from hours to minutes by enhancing the sensitivity and effectiveness of automated evaluations and self-improvement loops.
• Represent Search Verticals & International (SVI) in cross-Search forums.

Skills

Software development

SQL

Python

R

NDCG

Information retrieval

Precision recall

Leadership

Generative AI

LLMs

Agentic architectures

Education

Bachelor's degree

Master's degree or PhD

Job description

Google is seeking a Senior Software Engineer, Search AI Rater Quality, to advance AutoRater quality across search-related AI products. The role emphasizes collaboration with Search Platforms, Intelligence, and DeepMind, with emphasis on live events and factuality in multiple verticals.

The candidate should have 5+ years in software development, expertise in information retrieval metrics, and data analysis using SQL, R, or Python. Location options include NY or DC, with in-person interviews.