Technical Program Manager III, AI/ML Evaluations, Search

Google Inc.; Mountain View (CA); On-site; USD 163,000 - 236,000; Full time

Job summary

Google is seeking a Technical Program Manager III for AI/ML Evaluations in Search, based in Mountain View. You will lead complex, multi-disciplinary projects from planning to delivery, coordinating with product, engineering, and research teams.

The team focuses on evaluation quality and emerging needs, enabling data-driven decisions across AI initiatives. The role requires deep PM experience (5+ years) and expertise in AI/ML evaluation methodologies, data quality, and incorporating LLM tools

Qualifications

• Bachelor's degree in a technical field, or equivalent practical experience.
• 5 years of experience in program management.
• Experience in AI/ML evaluation methodologies, data quality, and process improvement.
• Experience integrating generative AI tools or Large Language Model (LLM) interfaces into workflows.

Responsibilities

• Engage with product, engineering, and research teams to identify and understand new and future evaluation requirements.
• Design, prototype, and pilot new evaluation methodologies, frameworks, and tooling to address unmet needs.
• Manage the end-to-end delivery of evaluations for eval and emerging use cases and product areas (e.g., Multimodal, Personalization).
• Communicate effectively with cross-functional stakeholders on evaluation quality, progress on emerging needs, and potential risks.
• Develop and maintain dashboards and reports to track key metrics related to quality, throughput, and the impact of the team's work.

Skills

AI/ML evaluation methodologies

Data quality

Process improvement

LLM interfaces integration

Education

Bachelor's degree in a technical field

Job description

Technical Program Manager III, AI/ML Evaluations, Search

Share Technical Program Manager III, AI/ML Evaluations, Search

• link Copy link

corporate_fare Google place Mountain View, CA, USA

Mid

Experience driving progress, solving problems, and mentoring more junior team members; deeper expertise and applied knowledge within relevant area.

Share Technical Program Manager III, AI/ML Evaluations, Search

• Bachelor's degree in a technical field, or equivalent practical experience.
• 5 years of experience in program management.
• Experience in AI/ML evaluation methodologies, data quality, and process improvement.
• Experience integrating generative AI tools or Large Language Model (LLM) interfaces into workflows.

Preferred qualifications:

• 5 years of experience managing cross-functional or cross-team projects.
• Experience in Machine Learning.

About the job

A problem isn’t truly solved until it’s solved for all. That’s why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Technical Program Manager at Google, you’ll use your technical expertise to lead complex, multi-disciplinary projects from start to finish. You’ll work with stakeholders to plan requirements, identify risks, manage project schedules, and communicate clearly with cross-functional partners across the company. You're equally comfortable explaining your team's analyses and recommendations to executives as you are discussing the technical tradeoffs in product development with engineers.

The Eval Quality and Emerging Needs (EQEN) team plays a crucial role in ensuring the trustworthiness and agility of our evaluation capabilities. This function is responsible for maintaining and enhancing the quality, reliability, and efficiency of all current human and automated evaluation processes by defining standards, developing guidelines, and implementing robust quality monitoring. Simultaneously, the EQEN team proactively identifies, scopes, and develops solutions for new and emerging evaluation requirements driven by product innovation and evolving organizational needs. Acting as an incubator, the team designs and pilots novel evaluation methodologies and frameworks, ensuring the organization is equipped to assess new technologies and product experiences. Through cross-functional collaboration, the EQEN team enables data-driven decision-making by providing high-integrity evaluation data and a clear pathway to support future evaluation demands.

In Google Search, we're reimagining what it means to search for information – any way and anywhere. To do that, we need to solve complex engineering challenges and expand our infrastructure, while maintaining a universally accessible and useful experience that people around the world rely on. In joining the Search team, you'll have an opportunity to make an impact on billions of people globally.

Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $163000 - $236000 (USD) + 15% bonus target + equity + benefits

Learn more about benefits at Google .

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy , Know your rights: workplace discrimination is illegal , Belonging at Google , and How we hire .

Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.

• Engage with product, engineering, and research teams to identify and understand new and future evaluation requirements.
• Design, prototype, and pilot new evaluation methodologies, frameworks, and tooling to address unmet needs.
• Manage the end-to-end delivery of evaluations for eval and emerging use cases and product areas (e.g., Multimodal, Personalization).
• Communicate effectively with cross-functional stakeholders on evaluation quality, progress on emerging needs, and potential risks.
• Develop and maintain dashboards and reports to track key metrics related to quality, throughput, and the impact of the team's work.

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy , Know your rights: workplace discrimination is illegal , Belonging at Google , and How we hire .

Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right.