Applied AI Model Quality Engineer

Google LLC; New York (NY); On-site; USD 174,000 - 252,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

Google LLC, based in New York, NY, is seeking a Software Engineer for Applied AI focusing on Model Quality. You will build automated evaluation systems, define metrics, and collaborate with research and cross-functional teams to improve model quality. In-person interviews are typical for this role.

The role sits within Google Pics and AI-powered workflows across Workspace, requiring experience in ML design and deployment. Equity and comprehensive benefits are included.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 5 years of experience with software development in one or more programming languages.
• 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.

Responsibilities

• Build evaluation systems for model performance (grounding, coherence, safety, helpfulness).
• Establish clear metrics for model evaluation and quality.
• Run evaluations across models/datasets using platforms and tools.
• Provide actionable insights to improve model quality in collaboration with research and cross-functional teams.
• Create tools to make evaluation processes more efficient.

Skills

5 years of software development

1 year software design & architecture

Education

Bachelor’s degree or equivalent practical experience

Master’s degree or PhD in Computer Science or related field

PhD in Computer Science

Job description

Google LLC, based in New York, NY, is seeking a Software Engineer for Applied AI focusing on Model Quality. You will build automated evaluation systems, define metrics, and collaborate with research and cross-functional teams to improve model quality. In-person interviews are typical for this role.

The role sits within Google Pics and AI-powered workflows across Workspace, requiring experience in ML design and deployment. Equity and comprehensive benefits are included.