Staff Product Manager, AI for Care

Verily Health; San Bruno (CA); On-site; USD 170,000 - 230,000; Full time

Job summary

Verily Health is seeking a Senior Product Manager to lead the AI Platform strategy for healthcare AI evaluations. You will own the Evaluation Harness and guide a team of software engineers and AI developers to build scalable, trustworthy tooling in a regulated domain.

The role emphasizes platform thinking, multi-tenant architecture, and collaboration with clinical, regulatory, and data science stakeholders to ensure trustworthy AI and measurable user value.

Qualifications

• 5+ years of product management on platform products.
• Hands-on AI Evaluation product experience with tooling.
• Deep technical foundation in software, data science, or healthcare informatics.
• Stakeholder negotiation to align a shared product vision.
• Experience owning a multi-tenant, versioned platform.

Responsibilities

• Build a platform that serves multiple customers and supports evaluation tools.
• Map user value through discovery, delivery, and iteration with your team.
• Collaborate with architects, engineers, and data scientists on architecture and tradeoffs.
• Align with clinical, regulatory, quality, security, and data science requirements to mitigate risk.
• Own the AI Evaluation Harness roadmap and coordinate stakeholder priorities across milestones.

Skills

Product management

AI evaluation tooling

Technical foundation

Stakeholder negotiation

Platform ownership

Tools

LLM-evaluation tooling

Golden datasets

Code assertions

Job description

Who We Are

Verily Health is a data platform and technology company purpose-built to power AI-enabled precision health solutions that accelerate research and improve care for individuals and communities. Uniquely positioned at the intersection of technology, data science, and healthcare, Verily transforms multimodal health data into insights, models, and actions that make healthcare more personalized, predictive, and precise.

Description

Verily Health builds healthcare solutions for customers in every vertical in the market from life sciences to health systems to health plans and to patients. Each of those solutions is powered by AI capabilities. where we need to continually verify that the output is meeting the needs of our end users.

You’ll own the product strategy for Verily's AI Platform, the capabilities that first- and third-party AI developers use to benchmark, evaluate, monitor, and improve AI experiences in healthcare. Your first major initiative will be focused on our Evaluation Harness. AI evaluations across Verily's solutions are paramount for establishing trust with our users and customers. The work will span everything from golden-dataset evals, code assertions, LLM-as-a-judge evals, error analysis, and customer feedback signals, from quick one-off checks to long-running validation for regulated use.

You’ll set a 12-month strategy and a longer vision for our AI Platform in healthcare, then lead a team of software engineers and AI developers, working beside them every day, to build it. The standard you set will shape how trustworthy healthcare AI gets made at Verily and beyond.

We’re looking for someone who has a track record of building AI developer tooling and infrastructure and wants to define how the healthcare industry does it.

Responsibilities

• Build a platform, not a point solution. Build evaluation tools for AI developers across many customers, verticals and clinical risk levels.
• Obsess about user value. Name your end users, map their journeys, deeply understand their unmet needs, and conduct continuous discovery, delivery, and iteration with your team. You are directly responsible for end to end user value creation.
• Build on Platform with technical credibility. Work as a peer with software architects, engineers, and data scientists on architecture and AI tradeoffs. Align solutions with Verily's existing platform capabilities, and work with other teams to extend those capabilities in ways that scale the platform rather than create one-offs.
• Compliance in healthcare. Align with subject matter experts across clinical, regulatory, quality, security, and data science to right-size and de-risk solutions for the business constraints we must operate within.
• Own the AI Evaluation Harness portfolio. Drive the roadmap across error analysis, golden datasets, code assertions, LLM-as-a-judge, and customer feedback signals, and align stakeholders when interests conflict. Own product strategy and prioritization. Develop and communicate at different levels of detail and time horizon based on the audience; 12-month product strategy, half-year milestones, quarterly delivery roadmap, and biweekly sprint priorities. Set the direction, sequence the steps, and stay hands‑on with the scrum team.

Qualifications

Minimum Qualifications

• 5+ years of product management on platform products. You have been embedded with engineering scrum teams, and have a record of shipping and operating the product, not just specifying it.
• Hands‑on AI Evaluation product experience. You have shipped AI evaluation tooling that customers use (LLM-as-a-judge frameworks, golden datasets, code assertions and trace tooling). You can name the products, describe in detail the hard problems you solved, and show the adoption and quality outcomes for end users.
• Deep technical foundation. You have a background in software engineering, systems engineering, data science, clinical informatics, or a comparable discipline. You can review architecture with engineers and go deep on LLM behavior with data scientists and be technically credible with them.
• Stakeholder negotiation. You have aligned technical and non-technical leaders around one product vision, and can give examples where you moved a conflicted group to a decision.
• Scale and complexity. You have owned a multi-tenant, version-controlled platform in a high-growth environment, with real tenancy, versioning, and backward-compatibility tradeoffs.

Preferred Qualifications

• Healthcare domain fluency: FHIR resources, clinical informatics, and interoperability standards. You know what a "correct" clinical output requires and who must sign off on it.
• Regulated environments: experience navigating HIPAA, GxP, FDA SaMD, or other healthcare compliance frameworks, ideally including building validation or audit evidence into a product.
• Clinical Specific AI - Experience building evals for clinical or high-stakes AI outputs (summarization, coding, triage, decision support), including clinician-in-th