Staff Software Engineer, AI Agents & Data Quality

Google Inc.; Mountain View (CA); On-site; USD 207,000 - 300,000; Full time

Job summary

Google DeepMind is seeking a GDM Staff Software Engineer focusing on Agent Data Quality. You will contribute to building AI agents, testing frameworks, and visualization systems, working within a mission-driven team in Mountain View, CA.

You will join a cross-disciplinary group advancing AI research with robust software engineering practices, focused on scalable data platforms and measurable agent performance.

Qualifications

• Bachelor's degree in Computer Science or Engineering or equivalent practical experience.
• Experience with Large Language Models (LLMs), NLP, or Generative AI.

Responsibilities

• Construct rigorous quantitative benchmarks and automated evaluation frameworks (including LLM-as-a-judge) to measure agent capabilities in reasoning, planning, and tool use.
• Develop end-to-end data flywheel on agent evalset curation, and automate and productionize the flywheel with agentic data pipelines.
• Develop a dedicated platform for "Self-Service Judges," allowing researchers to rapidly prototype and test new LLM-based classifiers and annotations against historical trajectory data.
• Establish a formal ecosystem for metric lifecycle management, including a sandbox for validating new metrics against a library of high-confidence calibration experiments.
• Productionize automated insights tools to identify the top movers of metric deltas across complex slices such as task type and user cohort.

Skills

LLMs/NLP expertise

Software engineering

Education

Bachelor's degree in Computer Science or Engineering

MBA or Master's degree in Computer Science

Tools

2D/3D game engines

Physics simulators

Visualization tools

Job description

Google DeepMind is seeking a GDM Staff Software Engineer focusing on Agent Data Quality. You will contribute to building AI agents, testing frameworks, and visualization systems, working within a mission-driven team in Mountain View, CA.

You will join a cross-disciplinary group advancing AI research with robust software engineering practices, focused on scalable data platforms and measurable agent performance.