Senior Product Manager, AI Platform

Verily Health; Southwestern Ontario; Hybrid; CAD 133,000 - 149,000; Full time

Job summary

Verily Health in Waterloo, Ontario seeks a Senior Product Manager to own the AI Evaluation Harness strategy, leading a team of software engineers and AI developers to build evaluation tools for healthcare customers.

You will map journeys, set a 12-month plan, and coordinate with clinical, regulatory, quality, and data science teams to balance platform goals with safety and compliance in regulated healthcare settings.

Qualifications

• 5+ years in platform product management embedded with engineering teams.
• Experience shipping AI evaluation tooling used by customers.
• Technical background to review architecture and discuss LLM behavior credibly.
• Ability to align technical and non-technical leaders around a shared vision.

Responsibilities

• Build evaluation tools for AI developers across customers and risk levels as a platform.
• Map end-user journeys, identify unmet needs, and drive discovery and delivery with your team.
• Collaborate with architects, engineers, and data scientists on architecture and AI tradeoffs.

Skills

Platform product management

AI tooling experience

Stakeholder alignment

Multi-tenant platform

Healthcare domain fluency

Tools

LLM frameworks

Data pipelines

FHIR basics

Job description

Verily Health combines technology, data science, and healthcare to transform complex health data into trusted intelligence. Its flagship platform, Verily Pre, enables healthcare organizations to responsibly govern, model, and securely activate protected health data at scale, with the scientific rigor, oversight, and auditability that healthcare requires. Verily builds solutions for customers across life sciences, health systems, health plans, and patients, all powered by AI capabilities.

The role

This role owns the product strategy for Verily's AI Evaluation Harness: the capabilities that first- and third-party AI developers use to benchmark, evaluate, monitor, and improve AI in healthcare. The harness spans golden-dataset evaluations, code assertions, LLM-as-a-judge evaluations, error analysis, and customer feedback signals, covering everything from quick one-off checks to long-running validation for regulated use. You would set a 12-month strategy and a longer vision for what evaluation becomes in healthcare, then lead a team of software engineers and AI developers, working alongside them every day to build it.

What you would do

• Build evaluation tools for AI developers across many customers, verticals, and clinical risk levels, treating this as a platform rather than a point solution.
• Map end-user journeys, identify unmet needs, and run continuous discovery, delivery, and iteration with your team, taking direct responsibility for end-to-end user value.
• Work as a peer with software architects, engineers, and data scientists on architecture and AI tradeoffs, aligning solutions with Verily's existing platform capabilities.
• Collaborate with clinical, regulatory, quality, security, and data science experts to right-size and de-risk solutions for healthcare compliance constraints.
• Develop and communicate product strategy at multiple levels of detail: 12-month strategy, half-year milestones, quarterly delivery roadmap, and biweekly sprint priorities.
• Drive the roadmap across error analysis, golden datasets, code assertions, LLM-as-a-judge, and customer feedback signals, and align stakeholders when interests conflict.

What they are looking for

• 5+ years of product management on platform products, with a record of shipping and operating products while embedded with engineering scrum teams.
• Hands-on experience shipping AI evaluation tooling that customers use (LLM-as-a-judge frameworks, golden datasets, code assertions, trace tooling), with demonstrable adoption and quality outcomes.
• A deep technical background in software engineering, systems engineering, data science, clinical informatics, or a comparable discipline, sufficient to review architecture and discuss LLM behavior credibly with engineers and data scientists.
• Demonstrated ability to align technical and non-technical leaders around a single product vision and move conflicted groups to a decision.
• Experience owning a multi-tenant, version-controlled platform in a high-growth environment, including real tenancy, versioning, and backward-compatibility tradeoffs.
• (Preferred) Healthcare domain fluency: FHIR resources, clinical informatics, and interoperability standards.
• (Preferred) Experience navigating regulated environments such as HIPAA, GxP, or FDA SaMD, including building validation or audit evidence into a product.
• (Preferred) Experience building evaluations for clinical or high-stakes AI outputs (summarization, coding, triage, decision support), including clinician-in-the-loop labeling and adjudication.

Working arrangements

This is a hybrid role based in Waterloo, Ontario, Canada. Candidates must be legally authorized to work in Canada. Verily is currently unable to offer employment-based visa or work permit sponsorship for this position.

Pay and benefits

The base salary range for this position is CAD 132,500 - CAD 149,000, plus bonus, equity, and benefits. Individual pay within the range is determined by work location, skills, experience, and relevant education or training.