Senior Data Analyst, Clinical AI Evaluation & Responsible AI - 0125-US-010

LexisNexis Risk Solutions; Pennsylvania; On-site; USD 90,000 - 130,000; Full time

Job summary

A leading company in healthcare solutions is seeking a Senior Data Analyst to join their generative AI evaluation team in Pennsylvania. The role focuses on assessing and validating AI models to enhance decision-making tools, ensuring safety, reliability, and compliance. The successful candidate will collaborate with cross-functional teams and leverage data analytics to improve AI solutions.

Benefits

Comprehensive health benefits

401(k) with match

Wellness platform with incentives

Short-and-Long Term Disability

Family benefits

Health Savings Account

Qualifications

• 6-9 years of experience in data analytics with focus on AI/ML evaluation.
• Expertise in evaluation frameworks for large language models.
• Experience using relational database management systems and BI tools.

Responsibilities

• Lead requirements gathering for generative AI models evaluation.
• Manage the analytics roadmap and collaborate with stakeholders.
• Conduct QA of AI outputs and participate in risk analysis.

Skills

AI model evaluation

Performance metrics analysis

Data visualization

Collaboration with teams

Risk analysis

Education

Bachelor's degree in Mathematics/Science

Master's or PhD preferred

Tools

Python

Tableau

PowerBI

SQL Server

Snowflake

PostgreSQL

Job description

Senior Data Analyst, Clinical AI Evaluation & Responsible AI - 0125-US-010 page is loaded

Senior Data Analyst, Clinical AI Evaluation & Responsible AI - 0125-US-010

Apply locations Pennsylvania time type Full time posted on Posted Yesterday job requisition id R90061

Do you like working with data and analytics to evaluate AI models and their performance?

Do you love collaborating with teams to assess and improve generative AI solutions?

About our Team

Elsevier is singularly focused on helping healthcare professionals improve clinical outcomes through evidence-based care. Our generative AI team works on evaluating and implementing cutting-edge AI technologies to enhance our healthcare solutions while ensuring their safety, reliability, and compliance with healthcare standards.

About the Role

We are seeking a motivated individual to join our dynamic generative AI evaluation team. We focus on assessing and validating AI models that support healthcare decision-making tools. Our team ensures that our AI solutions meet rigorous standards for accuracy, fairness, and clinical relevance. The successful candidate will help evaluate model performance, analyze output quality, and ensure our AI solutions align with healthcare best practices.

The successful candidate has relevant experience with AI model evaluation, including performance metrics analysis, output validation, and data visualization. They enjoy collaborating with cross-functional teams including AI researchers, product managers, clinicians, and engineers to evaluate AI models, analyze their outputs, and improve their performance in healthcare contexts.

Responsibilities

• Leading requirements gathering and development of analytics frameworks for evaluating generative AI models in healthcare applications
• Leading and defining the strategic direction for AI evaluation methodologies in their product area
• Managing the analytics roadmap for model evaluation. Collaborating with internal and external stakeholders to manage evaluation timelines and deliverables
• Defining, developing, and deploying queries and metrics to assess AI model performance and output quality
• Leading data model creation and maintenance for AI evaluation frameworks and monitoring systems
• Conducting comprehensive QA of AI outputs and participating in risk analysis and mitigation
• Understanding how security and privacy laws such as HIPAA affect AI deployment in healthcare. Understanding how to handle sensitive data including PHI and PII in AI contexts

Requirements

• 6-9 years of relevant experience in data analytics with focus on AI/ML evaluation
• Bachelor's degree required, Master's or PhD preferred in Mathematics/Science
• Demonstrated thought leadership in analytics strategy and enterprise-wide project implementation
• Have experience in a data analytics role with focus on AI/ML evaluation
• Have expertise in creating evaluation frameworks for large language models and other AI systems
• Have expertise in using and querying relational database management systems such as Microsoft SQL Server, Snowflake or postgreSQL
• Have expertise in using BI tools such as Tableau or PowerBI for AI performance visualization
• Be able to demonstrate experience using Python for AI model evaluation and output analysis

Working for you

We know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
- Health Benefits: Comprehensive, multi-carrier program for medical, dental and vision benefits
- Retirement Benefits: 401(k) with match and an Employee Share Purchase Plan
- Wellbeing: Wellness platform with incentives, Headspace app subscription, Employee Assistance and Time-off Programs
- Short-and-Long Term Disability, Life and Accidental Death Insurance, Critical Illness, and Hospital Indemnity
- Family Benefits, including bonding and family care leaves, adoption and surrogacy benefits
- Health Savings, Health Care, Dependent Care and Commuter Spending Accounts
- Up to two days of paid leave each to participate in Employee Resource Groups and to volunteer with your charity of choice

-----------------------------------------------------------------------

We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120.

Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here .

Please read our Candidate Privacy Policy .

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.

USA Job Seekers:

EEO Know Your Rights .

RELX is a global provider of information-based analytics and decision tools for professional and business customers, enabling them to make better decisions, get better results and be more productive.

Our purpose is to benefit society by developing products that help researchers advance scientific knowledge; doctors and nurses improve the lives of patients; lawyers promote the rule of law and achieve justice and fair results for their clients; businesses and governments prevent fraud; consumers access financial services and get fair prices on insurance; and customers learn about markets and complete transactions.

Our purpose guides our actions beyond the products that we develop. It defines us as a company. Every day across RELX our employees are inspired to undertake initiatives that make unique contributions to society and the communities in which we operate.