Lead Technology Product Manager, AI Quality & Evaluation

Wolters Kluwer

Chicago (IL)

On-site

USD 118,000 - 207,000

Full time

14 days+
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Benefits offered by this job

Medical, Dental, Vision plans
401(k) plan
Paid parental leave
Vacation and sick time

Job summary

Wolters Kluwer Health seeks a Senior Product Manager, AI Quality & Evaluation, to translate clinical quality standards into scalable product capabilities. You will work with clinical, data, and engineering teams to define requirements, workflows, tooling, automation, and reporting for AI-enabled experiences before and after launch.

This role focuses on operationalizing quality standards at scale, with usable tools, repeatable workflows, measurable signals, and clear evidence to inform product

Qualifications

  • 5+ years of product management experience in healthcare, enterprise SaaS, data-driven products, platform products, quality, or related areas.

Responsibilities

  • Translate expert-defined quality standards and evaluation methods into product requirements, workflows, and roadmap priorities.

Skills

Product management
Healthcare
Enterprise SaaS
Data-driven products
Quality

Job description

Build the product capabilities that help ensure AI-enabled healthcare experiences are useful, trusted, and responsibly deployed.

At Wolters Kluwer Health, the UpToDate suite supports millions of clinical decisions every day. As AI becomes part of healthcare workflows, quality cannot be treated as a one-time launch checkpoint. AI experiences need to be evaluated, monitored, and improved continuously so clinicians and care teams can trust the information and interactions they rely on.

As Senior Product Manager, AI Quality & Evaluation, you will play a core role in translating clinical quality standards and evaluation strategy into scalable product capabilities. Working under product leadership and in close partnership with clinical, technical, and data experts, you will help define the requirements, workflows, tooling, automation, and reporting needed to evaluate AI-enabled experiences before and after launch.

This role does not own the clinical quality standard or statistical methodology. It helps make those standards operational at scale through usable tools, repeatable workflows, measurable signals, and clear evidence that supports product decisions, customer trust, and responsible AI.

What You'll Do
  • Translate expert-defined quality standards and evaluation methods into product requirements, workflows, and roadmap priorities.
  • Drive discovery and delivery for defined AI quality and evaluation capabilities, including tooling, automation, monitoring, evidence capture, and reporting.
  • Partner with clinical, data science, engineering, product, legal, compliance, and customer-facing teams to operationalize AI evaluation before and after launch.
  • Identify opportunities to automate and scale evaluation workflows while preserving appropriate expert oversight.
  • Define product requirements for review workflows, issue triage, launch readiness, post-launch monitoring, and quality reporting.
  • Use evaluation insights to inform product improvements, user experience, content quality, model behavior, and operational processes.
  • Track emerging market practices and customer expectations related to AI quality, evaluation, benchmarking, and responsible AI.
  • Translate AI quality and evaluation practices into clear narratives for product leaders, customer-facing teams, and internal stakeholders.
What You'll Bring
  • 5+ years of product management experience in healthcare, enterprise SaaS, data-driven products, platform products, quality, or related areas.
  • Strong product discovery and execution skills, including requirements definition, roadmap planning, experimentation, and metrics-driven decision-making.
  • Ability to translate complex clinical, technical, quality, or risk concepts into practical product requirements and workflows.
  • Experience working with engineering, data, clinical, compliance, customer-facing, or operational stakeholders.
  • Strong analytical thinking and comfort defining metrics, dashboards, workflows, and decision criteria.
  • Strong communication skills, especially around quality, trust, tradeoffs, evidence, and customer value.
  • Curiosity and learning agility around AI, evaluation methods, responsible AI, and emerging technologies.
Preferred Background
  • Experience with AI-enabled products, healthcare technology, quality tooling, data products, search/retrieval quality, content quality, clinical validation, or decision-support products.
  • Familiarity with AI evaluation methods, benchmarks, monitoring, human-in-the-loop review, automation, or applied machine learning concepts.
  • Experience in healthcare, clinical workflows, regulated environments, or professional-information products.
  • Experience supporting customer-facing narratives around product quality, trust, or responsible technology.
What Success Looks Like
  • Expert-defined quality standards are translated into scalable product workflows, tools, and requirements.
  • Evaluation processes become more automated, repeatable, measurable, and usable by cross-functional teams.
  • Product teams have clearer quality signals and launch-readiness criteria for AI-enabled experiences.
  • Evaluation insights improve product quality, customer trust, user experience, and responsible AI practices.
  • Customer-facing teams can clearly explain how AI quality and trust are evaluated.
Our Interview Practices

To maintain a fair and genuine hiring process, we kindly ask that all candidates participate in interviews without the assistance of AI tools or external prompts. Our interview process is designed to assess your individual skills, experiences, and communication style. We value authenticity and want to ensure we’re getting to know you—not a digital assistant. To help maintain this integrity, we ask to remove virtual backgrounds and include in-person interviews in our hiring process. Please note that use of AI-generated responses or third-party support during interviews will be grounds for disqualification from the recruitment process.

Applicants may be required to appear onsite at a Wolters Kluwer office as part of the recruitment process.

Compensation

$118,300.00 - $207,400.00 USD

This role is eligible for Bonus.

Additional Information

Wolters Kluwer offers a wide variety of competitive benefits and programs to help meet your needs and balance your work and personal life, including but not limited to: Medical, Dental, & Vision Plans, 401(k), FSA/HSA, Commuter Benefits, Tuition Assistance Plan, Vacation and Sick Time, and Paid Parental Leave. Full details of our benefits are available upon request.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Lead Technology Product Manager, AI Quality & Evaluation
Lead Technology Product Manager, AI Quality & Evaluation

RXinsider LTD. • Chicago (IL), Northern (KY)

Hybrid
USD 118,000 - 207,000
Lead Technology Product Manager, AI Quality & Evaluation
Lead Technology Product Manager, AI Quality & Evaluation

Mass Digital Health • Waltham (MA)

On-site
USD 118,000 - 207,000
Lead Technology Product Manager, AI Quality & Evaluation
Lead Technology Product Manager, AI Quality & Evaluation

Wolters Kluwer N.V. • Chicago (IL)

Hybrid
USD 118,000 - 207,000
Medical, Dental, & Vision Plans
401(k) matching
Paid parental leave
+1
Lead Technology Product Manager, AI Clinical Decision Support
Lead Technology Product Manager, AI Clinical Decision Support

Mass Digital Health • Waltham (MA)

On-site
USD 118,000 - 207,000
Lead Technology Product Manager, Clinical AI Workflows
Lead Technology Product Manager, Clinical AI Workflows

Wolters Kluwer • Waltham (MA)

On-site
USD 129,000 - 226,000
Lead Technology Product Manager, AI Clinical Decision Support
Lead Technology Product Manager, AI Clinical Decision Support

Wolters Kluwer • Chicago (IL)

On-site
USD 118,000 - 207,000
Lead Technology Product Manager, AI Clinical Decision Support
Lead Technology Product Manager, AI Clinical Decision Support

RXinsider LTD. • Chicago (IL), Northern (KY)

Hybrid
USD 118,000 - 207,000
Medical benefits
Dental insurance
Vision plans
+4
Director, Product Management, Content Strategy & AI Readiness
Director, Product Management, Content Strategy & AI Readiness

Wolters Kluwer • Greenwood Village (CO)

On-site
USD 167,000 - 298,000
Bonus eligibility
Director, Product Management, Content Strategy & AI Readiness
Director, Product Management, Content Strategy & AI Readiness

Mass Digital Health • Waltham (MA)

On-site
USD 167,000 - 298,000
Medical benefits
401(k)
Paid parental leave
Lead Technology Product Manager, Clinical AI Workflows
Lead Technology Product Manager, Clinical AI Workflows

Mass Digital Health • Waltham (MA)

Hybrid
USD 128,000 - 227,000
Medical
Dental, & Vision Plans
401(k)
+5