Staff AI & Model Quality Engineer

Google Inc.; New York (NY); On-site; USD 207,000 - 300,000; Full time

Job summary

Google is hiring staff software engineers to advance AI model quality. You will build evaluation systems, define metrics for grounding, coherence, safety and helpfulness, and drive quality with cross-functional teams. The role sits within Google Pics and Gemini/GemPix initiatives, contributing to a 2026 GA roadmap.

You will work on evaluating and improving generative AI workflows, deploying scalable ML infrastructure and participating in a fast-paced, innovative environment at Google.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience with one or more: Speech/audio, reinforcement learning, ML infrastructure, or related ML field.
• 5 years of experience with ML design and ML infrastructure (deployment, evaluation, data processing, debugging, fine tuning).
• 5 years of experience testing and launching software products, and 3 years of experience with software design/architecture.
• Experience integrating generative AI tools or LLM interfaces into workflows.

Responsibilities

• Build both human-powered and LLM-powered automated evaluation systems to assess model performance.
• Establish clear metrics to measure grounding, coherence, safety, and helpfulness.
• Utilize platforms and tools to run evaluations across different models and datasets.
• Provide actionable insights from evaluations to improve model quality, in collaboration with research and cross-functional teams.
• Create tools and systems that make the evaluation process more efficient and effective.

Skills

Decision making

Stakeholder influence

Ambiguity handling

Software development

ML systems

Education

Bachelor's degree or equivalent

Tools

GemPix

Gemini

Job description

Google is hiring staff software engineers to advance AI model quality. You will build evaluation systems, define metrics for grounding, coherence, safety and helpfulness, and drive quality with cross-functional teams. The role sits within Google Pics and Gemini/GemPix initiatives, contributing to a 2026 GA roadmap.

You will work on evaluating and improving generative AI workflows, deploying scalable ML infrastructure and participating in a fast-paced, innovative environment at Google.