AI Product Operations Lead

KPMG LLP; Philadelphia (Philadelphia County); On-site; USD 140,000 - 180,000; Full time

Job summary

KPMG LLP seeks a Technical Product Manager for AI Product Operations to shape the internal AI monitoring product, drive its roadmap, and lead a cross-functional team. You will design evaluation systems, build real-time dashboards, and partner with audit and risk teams to ensure high-quality, compliant AI workflows.

This role requires deep ML/AI knowledge, strong communication, and a track record of leading high-performing teams within tech or data science environments.

Qualifications

• Minimum eight years in Technical Product Management, Product Operations, or Data Science.
• Strong technical background with a product mindset; deep ML/AI concepts understanding.
• Experience with Generative AI/LLMs, prompt engineering, and evaluation techniques.
• Excellent written and verbal communication for executive stakeholders.

Responsibilities

• Act as a player-coach managing a team of specialists and define a strategic roadmap for AI monitoring.
• Define roadmap for AI monitoring infrastructure and gather stakeholder requirements.
• Lead creation of real-time dashboards to interpret evaluation results and build monitors.
• Drive root-cause analysis and remediation, create scalable runbooks for deployments.
• Partner with product managers and engineering leaders to design evaluators into the product lifecycle and train on results.
• Collaborate with audit methodology, risk, and compliance to ensure AI evaluation flows support audit standards.
• Uphold integrity and professional environment.

Skills

Technical Product Management

Data Science understanding

AI/GenAI evaluation

Leadership of cross-functional teams

Stakeholder communication

Education

Master’s degree preferred

Bachelor’s degree required

Tools

Dashboard tools

Runbooks

Job description

KPMG LLP seeks a Technical Product Manager for AI Product Operations to shape the internal AI monitoring product, drive its roadmap, and lead a cross-functional team. You will design evaluation systems, build real-time dashboards, and partner with audit and risk teams to ensure high-quality, compliant AI workflows.

This role requires deep ML/AI knowledge, strong communication, and a track record of leading high-performing teams within tech or data science environments.