Senior Product Manager, AI Harness

Verily; Southwestern Ontario; Presencial; CAD 133.000 - 149.000; Jornada completa

Descripción de la vacante

Verily Health Inc. is seeking a seasoned product leader to own the AI Evaluation Harness strategy.

You will guide a team of software engineers and AI developers to build a scalable platform for evaluation, from golden datasets to LLM-as-a-judge, across multiple healthcare verticals. You will collaborate with architects, engineers, and data scientists to balance technical feasibility with clinical risk, ensuring compliance and end-user value while delivering on a clear 12-month roadmap and

Formación

• 5+ years of product management on platform products.
• Embedded with engineering scrum teams with proven shipping & operation.
• Hands-on AI Evaluation product experience.
• Shipped AI evaluation tooling used by customers (LLM-as-a-judge, golden datasets, code assertions, trace tooling).
• Able to name products and show adoption and quality outcomes for end users.
• Deep technical foundation in software engineering, systems engineering, data science, or clinical informatics.

Responsabilidades

• Build a platform, not a point solution.
• Create evaluation tools for AI developers across customers, verticals and risk levels.
• Obsess about user value and end-to-end value creation.
• Map user journeys and conduct continuous discovery with your team.
• Own the AI Evaluation Harness portfolio and roadmap across analyses and datasets.
• Work with software architects, engineers, and data scientists on architecture and AI tradeoffs.
• Align solutions with Verily’s platform capabilities and extend them to scale.
• Ensure healthcare compliance with clinical, regulatory, quality, security, and data science experts.
• Set strategy and priorities with a 12-month plan, milestones, and biweekly sprint priorities.
• Stay hands-on with the scrum team and drive delivery.

Conocimientos

PM on platform products

embedded with engineering scrum teams

Hands-on AI Evaluation product

AI evaluation tooling shipped

product naming & adoption evidence

technical software/data background

stakeholder negotiation

multi-tenant platform ownership

Descripción del empleo

About Verily Health Inc. At the intersection of technology, data science, and healthcare, Verily Health transforms complex health data into trusted intelligence, enabling health solutions that are more personal, predictive, and precise. Verily’s flagship Governed Health Intelligence platform, Verily Pre, enables healthcare organizations to responsibly govern, model, and securely activate their protected health data at scale, deploying intelligence with the scientific rigor, oversight, and auditability needed for healthcare. Description Verily Health builds healthcare solutions for customers in every vertical in the market from life sciences to health systems to health plans and to patients. Each of those solutions is powered by AI capabilities. where we need to continually verify that the output is meeting the needs of our end users. You’ll own the product strategy for Verily’s AI Evaluation Harness, the capabilities that first- and third-party AI developers use to benchmark, evaluate, monitor, and improve AI in healthcare. It spans golden-dataset evals, code assertions, LLM-as-a-judge evals, error analysis, and customer feedback signals, from quick one-off checks to long-running validation for regulated use. You’ll set a 12-month strategy and a longer vision for what evaluation becomes in healthcare, then lead a team of software engineers and AI developers, working beside them every day, to build it. The standard you set will shape how trustworthy healthcare AI gets made at Verily and beyond. We’re looking for someone who has built evaluation products before and wants to define how the healthcare industry does it.

Responsibilities

• Build a platform, not a point solution.
• Build evaluation tools for AI developers across many customers, verticals and clinical risk levels.
• Obsess about user value.
• Name your end users, map their journeys, deeply understand their unmet needs, and conduct continuous discovery, delivery, and iteration with your team.
• You are directly responsible for end to end user value creation.
• Build on Platform with technical credibility.
• Work as a peer with software architects, engineers, and data scientists on architecture and AI tradeoffs.
• Align solutions with Verily’s existing platform capabilities, and work with other teams to extend those capabilities in ways that scale the platform rather than create one-offs.
• Compliance in healthcare. Align with subject matter experts across clinical, regulatory, quality, security, and data science to right-size and de-risk solutions for the business constraints we must operate within.
• Own product strategy and prioritization. Develop and communicate at different levels of detail and time horizon based on the audience; 12-month product strategy, half-year milestones, quarterly delivery roadmap, and biweekly sprint priorities.
• Set the direction, sequence the steps, and stay hands-on with the scrum team.
• Own the AI Evaluation Harness portfolio. Drive the roadmap across error analysis, golden datasets, code assertions, LLM-as-a-judge, and customer feedback signals, and align stakeholders when interests conflict.

Minimum Qualifications

• 5+ years of product management on platform products.
• You have been embedded with engineering scrum teams, and have a record of shipping and operating the product, not just specifying it.
• Hands-on AI Evaluation product experience.
• You have shipped AI evaluation tooling that customers use (LLM-as-a-judge frameworks, golden datasets, code assertions and trace tooling).
• You can name the products, describe in detail the hard problems you solved, and show the adoption and quality outcomes for end users.
• Deep technical foundation. You have a background in software engineering, systems engineering, data science, clinical informatics, or a comparable discipline.
• You can review architecture with engineers and go deep on LLM behavior with data scientists and be technically credible with them.
• Stakeholder negotiation. You have aligned technical and non-technical leaders around one product vision, and can give examples where you moved a conflicted group to a decision.
• Scale and complexity. You have owned a multi-tenant, version-controlled platform in a high-growth environment, with real tenancy, versioning, and backward-compatibility tradeoffs.

Preferred Qualifications

• Healthcare domain fluency: FHIR resources, clinical informatics, and interoperability standards.
• You know what a “correct” clinical output requires and who must sign off on it.
• Regulated environments: experience navigating HIPAA, GxP, FDA SaMD, or other healthcare compliance frameworks, ideally including building validation or audit evidence into a product.
• Clinical Specific AI - Experience building evals for clinical or high-stakes AI outputs (summarization, coding, triage, decision support), including clinician-in-the-loop labeling and adjudication.

Qualified candidates must be legally authorized to work in Canada. Verily is currently unable to offer employment-based visa or work permit sponsorship for this position.

Compensation Information

• The CAN base salary range for this full-time position is $132,500-$149,000 + bonus + equity + benefits.
• Our salary ranges are determined by role, level, and location.
• The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations.
• Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
• Please note that the compensation details listed in CAN role postings reflect the base salary only, and do not include bonus, equity, or benefits.

Verily Health Inc. is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status.

Company Culture

Build What’s Vital. At Verily, you are a part of something bigger. We are a diverse team of builders innovating at the intersection of health and technology—united by a shared spirit of curiosity, resilience and determination to make better health possible for all. This builder mindset means your fingerprints will be on the work that shapes the future of health. Fulfilling our precision health purpose starts with the health of our Veeps, which is why we offer flexibility, resources, and competitive benefits to support you in your whole-person well being. Our culture reflects the behaviors that stem from living our values every day in how we Innovate Healthcare and Technology, Gain Velocity as One Verily, and Respect Individuals. As One Verily, we uphold our collective accountability to sustain this culture and to create an environment where all Veeps feel included, feel a sense of belonging, and have opportunities to grow.