Senior Data Analyst, Clinical AI Evaluation & Responsible AI - 0125-US-010

DataAnalystJobs.io; United States; Remote; USD 80,000 - 120,000; Full time

Job summary

An innovative firm is seeking a motivated individual to join their dynamic generative AI evaluation team. This role involves assessing and validating AI models that support healthcare decision-making tools, ensuring they meet standards for accuracy and clinical relevance. The ideal candidate will collaborate with AI researchers, product managers, and clinicians to enhance AI solutions in healthcare. If you have a passion for data analytics and AI model evaluation, this is an exciting opportunity to make a significant impact in the healthcare sector.

Benefits

Comprehensive health benefits

401(k) retirement plan with match

Wellness programs

Disability insurance

Life insurance

Critical illness insurance

Family benefits

Paid leave for volunteering

Headspace subscription

Qualifications

• 6-9 years of experience in data analytics focusing on AI/ML evaluation.
• Proven leadership in analytics strategy and enterprise projects.

Responsibilities

• Lead requirements gathering and develop analytics frameworks for AI evaluation.
• Manage evaluation timelines and deliverables in collaboration with stakeholders.

Skills

AI model evaluation

Data visualization

Performance metrics

Collaboration

Data analytics

SQL proficiency

Python programming

Education

Bachelor's degree in Mathematics or Science

Master's or PhD in Mathematics or Science

Tools

Microsoft SQL Server

Snowflake

PostgreSQL

Tableau

PowerBI

Job description

Do you like working with data and analytics to evaluate AI models and their performance?

Do you love collaborating with teams to assess and improve generative AI solutions?

About our Team

Elsevier is focused on helping healthcare professionals improve clinical outcomes through evidence-based care. Our generative AI team evaluates and implements cutting-edge AI technologies to enhance healthcare solutions while ensuring safety, reliability, and compliance with healthcare standards.

About the Role

We seek a motivated individual to join our dynamic generative AI evaluation team. The role involves assessing and validating AI models supporting healthcare decision-making tools, ensuring they meet standards for accuracy, fairness, and clinical relevance. The candidate will evaluate model performance, analyze output quality, and align AI solutions with healthcare best practices.

The ideal candidate has experience with AI model evaluation, including performance metrics, output validation, and data visualization. They enjoy collaborating with AI researchers, product managers, clinicians, and engineers to improve AI models in healthcare.

Responsibilities

• Lead requirements gathering and develop analytics frameworks for evaluating generative AI in healthcare
• Define strategic direction for AI evaluation methodologies
• Manage evaluation timelines and deliverables in collaboration with stakeholders
• Develop queries and metrics to assess AI performance and output quality
• Create and maintain data models for evaluation frameworks and monitoring systems
• Conduct QA of AI outputs and participate in risk analysis and mitigation
• Understand healthcare security and privacy laws like HIPAA and handle sensitive data responsibly

Requirements

• 6-9 years of experience in data analytics focusing on AI/ML evaluation
• Bachelor's degree required; Master's or PhD preferred in Mathematics or Science
• Proven leadership in analytics strategy and enterprise projects
• Experience in AI/ML evaluation roles
• Expertise in evaluation frameworks for large language models and AI systems
• Proficiency in SQL databases like Microsoft SQL Server, Snowflake, or PostgreSQL
• Experience with BI tools such as Tableau or PowerBI for AI performance visualization
• Proficiency in Python for AI model evaluation and output analysis

Working for You

We value your wellbeing and happiness. Our benefits include:

• Comprehensive health benefits
• Retirement plans including 401(k) with match
• Wellness programs, Headspace subscription, Employee Assistance, and time-off initiatives
• Disability, life, and critical illness insurance
• Family benefits such as leave, adoption, and surrogacy support
• Spending accounts for health, dependent care, and commuting
• Paid leave for ERG participation and volunteering

-----------------------------------------------------------------------

Elsevier is an equal opportunity employer. We consider all applicants without regard to race, color, creed, religion, sex, national origin, disability, veteran status, age, marital status, sexual orientation, gender identity, genetic information, or other protected characteristics.

If you require accommodations during the hiring process, please complete our Applicant Request Support Form or contact us at 1-855-833-5120.

Read our Candidate Privacy Policy.