Senior Engineering Analyst – AI Safety & Evaluation Leader

Google

Seattle (WA)

On-site

USD 159,000 - 230,000

Full time

3 days ago

Be an early applicant

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Life insurance

Disability insurance

401(k) matching

Paid time off 20 days

Job summary

Google’s Trust and Safety team in Seattle seeks a Senior Engineering Analyst/Tech Lead to architect and scale automated safety evaluation for next‑generation generative AI products. You will lead the transition from bespoke scripts to high‑throughput autoraters powering real‑time launch decisions.

You will collaborate with Product, Search Core, and GDM engineers to align technical roadmaps, enforce safety guardrails, and drive robust AI integrity across critical domains with sub‑100ms response

Qualifications

Bachelor's degree or equivalent practical experience.
5 years of experience in data analysis, including identifying trends, generating summary statistics, and drawing insights from quantitative and qualitative data.
5 years of experience in the anti-abuse domain, with a focus on signal analysis, model development, data analysis, and cyber security.
Experience programming in one or more languages (e.g., SQL, Python, or Golang).

Responsibilities

Establish metrics and benchmark Generative-AI issues; quantify improvements across products.
Drive project delivery; manage interdependent projects of moderate to high complexity.
Improve tools through data analysis and presentations to stakeholders; identify automation opportunities.
Design, develop, and scale production-grade LLM-as-a-judge autoraters and evaluation systems for real-time decisions.
Coordinate with Product, Search Core, and GDM engineering teams to align roadmaps and risk registers.