Senior AI Safety & Trust Analytics Engineer

Google; Atlanta (GA); On-site; USD 159,000 - 230,000; Full time

Benefits offered by this job

Health insurance

Retirement plan

Paid time off

Sick time

Maternity leave

Baby bonding leave

Holidays

Job summary

Google in the Trust and Safety group is seeking a Senior Engineering Analyst/Tech Lead to architect and scale automated safety evaluation and enforcement platforms powering next-generation generative AI products.

You will drive the transition from bespoke scripts to high-throughput, low-latency LLM-as-a-judge autorater infrastructure, supporting offline testing and real-time launch decisions, while collaborating with Product, Search Core, and GDM engineers.

Qualifications

• Bachelor's degree or equivalent practical experience in a relevant field.
• 5 years of data analysis experience identifying trends, generating summary statistics, and drawing insights from quantitative and qualitative data.
• 5 years of experience in the anti-abuse domain, with a focus on signal analysis, model development, data analysis, and cyber security.
• Experience programming in one or more languages (e.g., SQL, Python, or Golang).

Responsibilities

• Learn more about benefits at Google.
• Help to establish metrics, benchmarking Generative-AI issues and quantify improvements. Develop datasets and run evals for engineers to evaluate and improve Search, Labs and Assistant products.
• Use technical judgment to drive project delivery, challenge proposals and identify risks. Manage interdependent projects of moderate to high complexity against crashed timelines.
• Improve tools through data analysis, technical expertise, and presentations to key stakeholders. Enhance operational workflows via process improvements and identification of automation opportunities.
• Design, develop, and scale production-grade LLM-as-a-judge autoraters and automated evaluation systems to run real-time launch decisions and continuous regression testing across core verticals.
• Partner directly with Product, Search Core, and GDM engineering teams to drive alignment on technical roadmaps, integrations and cross-product risk registers.

Skills

Data analysis

Anti-abuse domain experience

SQL

Python

Golang

Education

Bachelor's degree or equivalent

Tools

SQL

Python

Go

Job description

Google in the Trust and Safety group is seeking a Senior Engineering Analyst/Tech Lead to architect and scale automated safety evaluation and enforcement platforms powering next-generation generative AI products.

You will drive the transition from bespoke scripts to high-throughput, low-latency LLM-as-a-judge autorater infrastructure, supporting offline testing and real-time launch decisions, while collaborating with Product, Search Core, and GDM engineers.