Senior AI Evaluation & Testing Lead

Google; Seattle (WA); On-site; USD 171,000 - 247,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Life insurance

Disability insurance

401(k) with company match

Paid time off

Sick time

Job summary

Google is seeking a leader in AI testing and evaluation within the Trust and Safety ecosystem. You will design novel, data-driven evaluation methods for emerging AI products and partner with DeepMind and Data Science to push the boundaries beyond standard benchmarks.

You will define safety standards, mentor analysts, and coordinate with engineering teams to build scalable evaluation infrastructure. The role requires a researcher mindset and technical agility to translate insights into

Qualifications

• Bachelor's degree or equivalent practical experience.
• 10 years of experience in AI testing or research, data analytics, data science, or a related field.

Responsibilities

• Drive the methodological frontier of model evaluation and develop data-driven testing methodologies.
• Define testing and safety standards, and develop model-wide mitigations.
• Lead cross-functional teams to implement safety initiatives and advise executives.
• Represent Google's AI safety efforts in external forums and mentor analysts.
• Work with sensitive content, potentially facing graphic or upsetting topics.

Skills

AI testing experience

Data analytics

SQL

Python

Experiment design

Cross-functional collaboration

Education

Bachelor's degree or equivalent practical experience

Master's degree or PhD in relevant field

Job description

Google is seeking a leader in AI testing and evaluation within the Trust and Safety ecosystem. You will design novel, data-driven evaluation methods for emerging AI products and partner with DeepMind and Data Science to push the boundaries beyond standard benchmarks.

You will define safety standards, mentor analysts, and coordinate with engineering teams to build scalable evaluation infrastructure. The role requires a researcher mindset and technical agility to translate insights into