Staff Data Scientist, Measurement Methodology Innovation

Google LLC

New York, Mountain View (NY, CA)

On-site

USD 207,000 - 300,000

Full time

7 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Google LLC is seeking a Staff Data Scientist for Measurement Methodology Innovation in New York. This role focuses on building automated evaluation platforms, synthetic modeling, and LLM-based predictive engines to quantify and improve search quality at scale.

The position emphasizes rigorous validation, cross‑functional collaboration with engineering and product teams, and the ability to translate complex analyses into concrete business recommendations.

Qualifications

  • Master's degree in Statistics, Data Science, Mathematics, Physics, Economics, Operations Research, Engineering, or a related quantitative field.
  • 8+ years of work experience using analytics with coding (Python, R, SQL) or 6+ years with a PhD.
  • Proven ability to translate analyses into business impact and actionable recommendations.

Responsibilities

  • Pioneer novel generative modeling and simulation techniques translating multimodal data into synthetic evaluation frameworks.
  • Architect and iterate on next‑generation LLM-based pipelines to model cognitive dynamics and user behaviors.
  • Design and execute rigorous validation paradigms and backtesting against historical benchmarks.
  • Drive cross‑functional collaboration to integrate automated evaluation platforms into the experimentation lifecycle.
  • Conduct advanced analytics on large-scale discovery environments to accelerate product quality measurement and algorithmic iteration.

Skills

Analytics
Python
R
SQL

Education

Master's degree
PhD

Job description

Staff Data Scientist, Measurement Methodology Innovation

Share Staff Data Scientist, Measurement Methodology Innovation

corporate_fare Google place New York, NY, USA ; Mountain View, CA, USA

X In most instances, this position requires in-person interviews as part of the hiring process.Note: By applying to this position you will have an opportunity to share your preferred working location from the following: New York, NY, USA; Mountain View, CA, USA.

  • Master's degree in Statistics, Data Science, Mathematics, Physics, Economics, Operations Research, Engineering, or a related quantitative field.
  • 8 years of work experience using analytics to solve product or business problems, coding (e.g., Python, R, SQL), querying databases or statistical analysis, or 6 years of work experience with a PhD degree.
Preferred qualifications:
  • 10 years of work experience using analytics to solve product or business problems, coding (e.g., Python, R, SQL), querying databases or statistical analysis, or 8 years of work experience with a PhD degree.
  • Experience articulating business questions and using mathematical techniques to arrive at an answer using available data. Experience translating analysis results into business recommendations.
  • Applied experience with machine learning on large datasets.
  • Ability to select the right statistical tools given a data analysis problem along with effective communication skills.
  • Excellent leadership and self-direction skills along with willingness to both teach others and learn new techniques.
About the job

As a Data Scientist for Search Quality, you will drive measurement technology innovation at the core of the Search Quality. You will spearhead the development of an automated eval platform designed for next-generation experimentation. In this role, you will pioneer novel synthetic modeling techniques that translate multifaceted real-world behavioral and cognitive signals into high-fidelity simulations. You will build a cutting-edge Large Language Model (LLM)-based framework and predictive scoring engines to model complex user dynamics at scale. Furthermore, you will establish advanced validation and backtest simulation frameworks against large-scale historical benchmarks to dramatically accelerate the frontier of product quality evaluation.

In Google Search, we're reimagining what it means to search for information – any way and anywhere. To do that, we need to solve complex engineering challenges and expand our infrastructure, while maintaining a universally accessible and useful experience that people around the world rely on. In joining the Search team, you'll have an opportunity to make an impact on billions of people globally.

Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits

  • Pioneer novel generative modeling and simulation techniques, translating multimodal data and behavioral signals into high-fidelity synthetic evaluation frameworks.
  • Architect and iterate on next-generation LLM-based pipelines, building scalable predictive engines to model complex cognitive dynamics, sentiment, and latent user behaviors.
  • Design and execute rigorous validation paradigms, establishing backtesting frameworks against historical benchmarks to verify simulation fidelity and predictive precision.
  • Drive cross-functional innovation with engineering, research, and product teams to integrate automated evaluation platforms into the core experimentation lifecycle.
  • Conduct advanced analytical and statistical investigations on large-scale discovery environments, developing new methodologies to accelerate product quality measurement and algorithmic iteration.

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy , Know your rights: workplace discrimination is illegal , Belonging at Google , and How we hire .

Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.

Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Data Scientist, Measurement Methodology Innovation
Staff Data Scientist, Measurement Methodology Innovation

Google • New York (NY)

Hybrid
USD 207,000 - 300,000
Equity
Benefits
Staff Research Data Scientist, Search AI Product
Staff Research Data Scientist, Search AI Product

Google • New York (NY)

On-site
USD 207,000 - 300,000
Senior Data Scientist, Web Quality and AI Context Engineering
Senior Data Scientist, Web Quality and AI Context Engineering

Google LLC • Mountain View (CA), New York (NY)

On-site
USD 174,000 - 252,000
Staff Data Scientist Manager, Search AI Overview
Staff Data Scientist Manager, Search AI Overview

Google • Mountain View (CA)

On-site
USD 207,000 - 300,000
Staff Software Engineer, AI/ML GenAI, Search Intelligence
Staff Software Engineer, AI/ML GenAI, Search Intelligence

Google LLC • Mountain View (CA)

On-site
USD 207,000 - 300,000
Staff Research Data Scientist, Search Ads, Ads Metrics
Staff Research Data Scientist, Search Ads, Ads Metrics

Google LLC • New York (NY)

On-site
USD 207,000 - 300,000
Equity
Bonus target
Benefits
Senior Product Data Scientist, Customer Engagement
Senior Product Data Scientist, Customer Engagement

Google Inc. • Mountain View (CA)

On-site
USD 163,000 - 236,000
Research Data Scientist, Search Ads, Google Experience
Research Data Scientist, Search Ads, Google Experience

Google Inc. • Northern (KY), New York (NY)

On-site
USD 147,000 - 210,000
Equity grants
Senior Product Data Scientist, Search App Growth
Senior Product Data Scientist, Search App Growth

Google Inc. • Mountain View (CA)

On-site
USD 163,000 - 236,000
Equity
Bonus target 15%
Benefits package
Staff Data Scientist, Research, Search Health
Staff Data Scientist, Research, Search Health

Google LLC • Mountain View (CA), New York (NY)

On-site
USD 207,000 - 300,000
Equity
Bonus target