Principal Technical Product Manager, Evaluations & Governance

RBC

Toronto

On-site

CAD 180,000 - 210,000

Full time

26 hours ago

Be an early applicant

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Bonuses

Stock options

Flexible benefits

Job summary

RBC in Toronto seeks an experienced product leader to own the evaluations and governance capabilities for AI at scale. You will align risk, compliance, and business needs, shaping the strategy and roadmap for safe, scalable AI across the bank's platform.

You will partner with engineering, risk, and compliance to drive the portfolio, define metrics, and ensure timely delivery while influencing senior leadership on AI health and trajectory.

Qualifications

Minimum 10 years in product management with risk or governance exposure.
Demonstrated delivery of AI/ML systems in enterprise settings; hands-on LLM integration.
Experience in regulated industries with audit/regulatory exposure.
Strong collaboration with engineers, risk, and compliance teams.

Responsibilities

Own end-to-end product strategy and multi-year roadmap for evaluations and governance.
Translate stakeholder input into clear requirements and prioritize across the roadmap.
Evaluate build-vs-buy-vs-partner options for governance tooling and report to leadership.
Partner with engineering on feasibility, sequencing, and commitments; manage delivery.
Represent product voice to risk, audit, and compliance across business lines.
Define success metrics and incorporate insights into business cases.

Skills

Product management

AI/ML systems

Regulated industry experience

LLM API integration

System design

Observability

Executive communication

Education

Bachelor's degree in Computer Science/Engineering

Tools

OpenAI/Azure OpenAI

Anthropic Claude

Vector databases

API integration patterns

Job description

What is the opportunity?

Deploying AI at scale in Canada's largest bank is the opportunity of a lifetime. This role focuses on one of the most critical enablers of AI at RBC, connecting deep evaluation of agents' performance and accuracy with the risk-based governance that allows AI to be enabled for safe use.

Own product strategy for the evaluations and governance capabilities that let the bank build and scale agentic AI responsibly — the layer that assesses AI system quality and safety before and after deployment, and turns those assessments into risk and compliance reporting that business leaders across the bank can act on. This is the single accountable product leader for a capability area that sits at the center of how the bank governs its growing AI footprint, partnering closely with engineering leadership, risk, and compliance stakeholders to keep pace with an area that’s evolving quickly both technically and regulatorily.

What will you do?

Product Strategy & Roadmap

Own end-to-end product strategy and a multi-year roadmap for the evaluations and governance capability area, prioritized against business risk, regulatory need, and platform adoption
Lead discovery and requirements definition, translating input from engineering, risk, compliance, and business stakeholders into clear product requirements
Own portfolio-level prioritization and sequencing across the capability area’s roadmap, balancing near-term regulatory/compliance needs against longer-term platform investment
Evaluate build-vs-buy-vs-partner options for evaluation and governance tooling, weighing internal investment against third-party solutions

Delivery Partnership

Partner with engineering and architecture leadership on feasibility, sequencing, and trade-offs, converging on a plan both sides can commit to
Work with the project-management function to convert prioritized requirements into a funded, scheduled program of work
Stay engaged through delivery, resolving product-scope questions and re-planning trade-offs as they arise

Stakeholder & Business Engagement

Represent the capability area to risk, audit, and compliance stakeholders across the bank’s business lines
Serve as the primary product voice to senior leadership on the health and trajectory of the capability area
Represent product considerations within architecture reviews, governance forums, and vendor evaluations
Partner with adjacent product and engineering leaders across the platform so requirements are considered early, not retrofitted later

Launch & Value Input

Help define value messaging and target user personas for the capability area’s launches, in partnership with your peer Principal for go-to-market
Define and track success metrics for the capability area and use them to inform ongoing prioritization
Contribute the capability area’s inputs into the broader business case articulating value delivered

People Leadership

Build, mentor, and lead a team of product managers focused on evaluations and governance, giving them ownership of their individual areas
Help your team apply consistent discovery, prioritization, and delivery practices as they build out their own areas
Foster a culture of iterative delivery, understanding of user needs, and decision-making backed by data

What do you need to succeed?

Must-have:

10+ years of product management experience, including several years focused on risk, compliance, safety, or governance-oriented technology products or services
Demonstrated experience delivering production AI/ML systems in an enterprise environment, including hands‑on experience with LLM API integration (e.g., Anthropic Claude, OpenAI, Azure OpenAI, or equivalent) and direct ownership of how those systems are tested, evaluated, or monitored for quality and risk
Experience operating in a regulated industry (e.g., financial services, healthcare, government) with direct exposure to audit and regulatory review processes
Strong technical foundation — able to engage credibly with engineers and architects on system design, API integration patterns (authentication, rate limiting, observability), data pipelines, and vector database/retrieval-augmented generation (RAG) architecture as it relates to evaluating AI system outputs
Excellent communication skills, with proven ability to represent a complex technical and risk‑related agenda credibly to both senior executives and engineering teams
University degree in a technical field (Computer Science, Engineering, or related), or equivalent experience

Nice-to-have:

Experience leading and developing other product managers, or a track record of stepping into a people‑leadership role from an individual‑contributor/lead‑level product position
Demonstrated experience building products that convert regulatory or audit requirements into automated processes or tooling
Experience defining shared interfaces or working agreements between two or more engineering teams building interdependent systems
Prior experience specifically with AI safety, model risk management, or automated evaluation of AI/ML systems, rather than general software QA/compliance
Experience with observability or monitoring platforms for distributed or ML‑based systems
Familiarity with AI‑specific financial‑services regulatory and risk‑management frameworks (e.g., OSFI Guideline E‑23, NIST AI RMF, SR 26‑2, ISO/IEC 42001) — familiarity with the direction these are heading is more relevant than hands‑on implementation experience, since several (e.g., OSFI E‑23) are not yet in force Experience standing up a net‑new function inside a scaling organization, rather than in a steady‑state team

What’s in it for you?

We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.

A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
Leaders who support your development through coaching and managing opportunities
Ability to make a difference and lasting impact
Work in a dynamic, collaborative, progressive, and high‑performing team
A world‑class training program in financial services
Flexible work/life balance options
Opportunities to do challenging work

About The AI Group

RBC’s AI Group is the AI accelerator for RBC, with a focus on driving the shift from early‑stage AI projects to scaled, client outcomes that amplify the impact of RBC’s people. In addition to helping scale the biggest AI opportunities at RBC, the AI Group is responsible for advancing research into emerging use cases across generative and agentic AI, while maintaining expertise in security, responsible AI and regulatory expectations.

Inclusion and Equal Opportunity Employment

RBC is an equal opportunity employer committed to diversity and inclusion. We are pleased to consider all qualified applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veterans status, Aboriginal/Native American status or any other legally‑protected factors. Disability‑related accommodations during the application process are available upon request.

Job Skills

Communication, Critical Thinking, Effectiveness Measurement, Financial Regulation, Interpersonal Relationship Management, Long Term Planning, Product Development Lifecycle, Product Development Methodology, Product Services, Results‑Oriented, Waterfall Model

Additional Job Details