Senior TPM: AI/ML Evaluations for Search

Google; Mountain View (CA); On-site; USD 163,000 - 236,000; Full time

Job summary

Google in Mountain View, CA is seeking a Technical Program Manager III to lead AI/ML evaluation efforts within the Search domain. You will drive multi-disciplinary projects, coordinate with product, engineering and research teams, plan requirements, manage risks, and communicate clearly with executives and engineers alike.

The Eval Quality and Emerging Needs (EQEN) team develops new evaluation methodologies and ensures data integrity for both human and automated evaluations.

Qualifications

• Bachelor's degree in a technical field or equivalent practical experience.
• 5+ years of program management experience.
• Experience in AI/ML evaluation methodologies, data quality, and process improvement.
• Experience integrating generative AI tools or LLM interfaces into workflows.
• 5 years of experience managing cross-functional or cross-team projects.
• Experience in Machine Learning.

Responsibilities

• Engage with product, engineering, and research teams to identify and understand new and future evaluation requirements.
• Design, prototype, and pilot new evaluation methodologies, frameworks, and tooling to address unmet needs.
• Manage the end-to-end delivery of evaluations for eval and emerging use cases and product areas (e.g., Multimodal, Personalization).
• Communicate effectively with cross-functional stakeholders on evaluation quality, progress on emerging needs, and potential risks.
• Develop and maintain dashboards and reports to track key metrics related to quality, throughput, and the impact of the team's work.

Skills

Program management

AI/ML evaluation

Data quality

LLM workflows

Cross-functional collaboration

Education

Bachelor's degree in a technical field

Job description

Google in Mountain View, CA is seeking a Technical Program Manager III to lead AI/ML evaluation efforts within the Search domain. You will drive multi-disciplinary projects, coordinate with product, engineering and research teams, plan requirements, manage risks, and communicate clearly with executives and engineers alike.

The Eval Quality and Emerging Needs (EQEN) team develops new evaluation methodologies and ensures data integrity for both human and automated evaluations.