Senior Data Analyst, Clinical AI Evaluation & Responsible AI - 0125-US-010

Elsevier; Pennsylvania; On-site; USD 66,000 - 136,000; Full time

Job summary

A leading technology company seeks a Senior Data Analyst to join their generative AI evaluation team. The successful candidate will play a critical role in assessing AI models for healthcare, ensuring accuracy and compliance with regulations. With a focus on collaboration, this role offers the opportunity to influence AI solutions that improve clinical outcomes. Benefits include comprehensive health programs, retirement plans, and wellness incentives.

Benefits

Comprehensive health benefits

Retirement benefits

Wellness platform with incentives

Short-and-Long Term Disability Insurance

Family benefits including bonding leave

Qualifications

• 6-9 years of relevant experience in data analytics with focus on AI/ML evaluation.
• Experience in using relational database management systems.
• Expertise in creating evaluation frameworks for AI systems.

Responsibilities

• Leading requirements gathering for evaluating generative AI models.
• Managing the analytics roadmap for model evaluation.
• Conducting QA of AI outputs and risk analysis.

Skills

Data Analytics

AI/ML Evaluation

Data Visualization

Collaboration

Performance Analysis

Risk Analysis

Education

Bachelor's degree

Master's or PhD in Mathematics/Science

Tools

Microsoft SQL Server

Snowflake

PostgreSQL

Tableau

Power BI

Python

Job description

Senior Data Analyst, Clinical AI Evaluation & Responsible AI - 0125-US-010

Join to apply for the Senior Data Analyst, Clinical AI Evaluation & Responsible AI - 0125-US-010 role at RELX

Continue with Google Continue with Google

Senior Data Analyst, Clinical AI Evaluation & Responsible AI - 0125-US-010

6 days ago Be among the first 25 applicants

Join to apply for the Senior Data Analyst, Clinical AI Evaluation & Responsible AI - 0125-US-010 role at RELX

Do you like working with data and analytics to evaluate AI models and their performance?

Do you love collaborating with teams to assess and improve generative AI solutions?

About Our Team

Elsevier is singularly focused on helping healthcare professionals improve clinical outcomes through evidence-based care. Our generative AI team works on evaluating and implementing cutting-edge AI technologies to enhance our healthcare solutions while ensuring their safety, reliability, and compliance with healthcare standards.

About The Role

We are seeking a motivated individual to join our dynamic generative AI evaluation team. We focus on assessing and validating AI models that support healthcare decision-making tools. Our team ensures that our AI solutions meet rigorous standards for accuracy, fairness, and clinical relevance. The successful candidate will help evaluate model performance, analyze output quality, and ensure our AI solutions align with healthcare best practices.

The successful candidate has relevant experience with AI model evaluation, including performance metrics analysis, output validation, and data visualization. They enjoy collaborating with cross-functional teams including AI researchers, product managers, clinicians, and engineers to evaluate AI models, analyze their outputs, and improve their performance in healthcare contexts.

Responsibilities

• Leading requirements gathering and development of analytics frameworks for evaluating generative AI models in healthcare applications
• Leading and defining the strategic direction for AI evaluation methodologies in their product area
• Managing the analytics roadmap for model evaluation. Collaborating with internal and external stakeholders to manage evaluation timelines and deliverables
• Defining, developing, and deploying queries and metrics to assess AI model performance and output quality
• Leading data model creation and maintenance for AI evaluation frameworks and monitoring systems
• Conducting comprehensive QA of AI outputs and participating in risk analysis and mitigation
• Understanding how security and privacy laws such as HIPAA affect AI deployment in healthcare. Understanding how to handle sensitive data including PHI and PII in AI contexts
  
  

Requirements

• 6-9 years of relevant experience in data analytics with focus on AI/ML evaluation
• Bachelor's degree required, Master's or PhD preferred in Mathematics/Science
• Demonstrated thought leadership in analytics strategy and enterprise-wide project implementation
• Have experience in a data analytics role with focus on AI/ML evaluation
• Have expertise in creating evaluation frameworks for large language models and other AI systems
• Have expertise in using and querying relational database management systems such as Microsoft SQL Server, Snowflake or postgreSQL
• Have expertise in using BI tools such as Tableau or PowerBI for AI performance visualization
• Be able to demonstrate experience using Python for AI model evaluation and output analysis
  
  

Working for you

Benefits

We know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:

• Health Benefits: Comprehensive, multi-carrier program for medical, dental and vision benefits
• Retirement Benefits: 401(k) with match and an Employee Share Purchase Plan
• Wellbeing: Wellness platform with incentives, Headspace app subscription, Employee Assistance and Time-off Programs
• Short-and-Long Term Disability, Life and Accidental Death Insurance, Critical Illness, and Hospital Indemnity
• Family Benefits, including bonding and family care leaves, adoption and surrogacy benefits
• Health Savings, Health Care, Dependent Care and Commuter Spending Accounts
• Up to two days of paid leave each to participate in Employee Resource Groups and to volunteer with your charity of choice

Seniority level

• Seniority level

  Not Applicable

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Technology, Information and Media

Referrals increase your chances of interviewing at RELX by 2x

Get notified about new Senior Data Analyst jobs in Pennsylvania, United States.

Senior Data Analyst with Snowflake experience

LIMS Master Data Governance Business Analyst / Admin

Pittsburgh, PA
$66,000.00
-
$135,600.00
1 week ago

Senior Logistics Analyst – Parcel & eCommerce Logistics

Financial Planning & Analysis Analyst - Power BI Job

Business Analyst (Oneshield and Billing)

Pittsburgh, PA
$89,100.00
-
$126,900.00
9 hours ago

Manager, Analytics, Local Media Development

Systems Business Analyst II (Data Protection)

Allentown, PA $102,890.67 - $139,637.34 1 month ago

Philadelphia, PA $110,000 - $130,000 6 days ago

Williamsport, PA $102,890.67 - $139,637.34 1 month ago

Pittsburgh, PA $80,000 - $100,000 1 week ago

Business Analyst Senior--Learning and Talent Development

Williamsport, PA $102,890.67 - $139,637.34 1 month ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.