Senior Clinical AI Evaluation & Governance Lead

UnitedHealthcare; Minnetonka (MN); Hybride; USD 113 000 - 193 000; Plein temps

Résumé du poste

UnitedHealthcare is seeking a Principal-level AI governance expert to lead evaluation frameworks for AI-enabled clinical products. You will ensure rigorous testing, transparent evidence, and objective decision support for the Clinical AI Governance Council.

The role spans cross-functional collaboration across clinical, data science, engineering, Legal, and Compliance, with a mix of remote work and in-office requirements in the Minneapolis area.

Qualifications

• 5+ years of experience working with healthcare data or related domains.
• 5+ years of experience using Python, SQL, or R to develop analytic solutions.
• 3+ years of hands-on experience developing or evaluating AI solutions.
• 3+ years of experience designing or overseeing testing and evaluation of AI-enabled solutions.

Responsabilités

• Apply the submission framework to use cases ensuring analytic components align the AI's use and risks, metrics, and thresholds.
• Define use case-specific measurable performance criteria translating clinical risks into metrics and thresholds for decisions.
• Ensure complete evaluation methods at intake including data, populations, comparators, metrics, test methods, and study design.
• Serve as the primary technical liaison across data science, clinical, and engineering SMEs, synthesizing inputs into a consistent evaluation approach.
• Ensure evaluation results support clear decisions against defined performance thresholds.
• Develop concise, decision-ready summaries of performance against defined thresholds and limitations of the AI program.
• Provide independent evaluation during Council review and address questions on evaluation design and results.
• Integrate analytic and operational inputs into a single, aligned recommendation.
• Define requirements for post-deployment monitoring including metrics and triggers for re-review.
• Design and execute analytic evaluations of clinical AI use cases using real-world data.
• Perform hands-on data programming, analysis, and interpretation to support reviews.

Connaissances

Healthcare data

Python

SQL

R

Cross-functional collaboration

Outils

NLP

LLM

ML evaluation

Description du poste

UnitedHealthcare is seeking a Principal-level AI governance expert to lead evaluation frameworks for AI-enabled clinical products. You will ensure rigorous testing, transparent evidence, and objective decision support for the Clinical AI Governance Council.

The role spans cross-functional collaboration across clinical, data science, engineering, Legal, and Compliance, with a mix of remote work and in-office requirements in the Minneapolis area.