Senior AI Model Evaluation & Analytics Lead

Elsevier; United States; Remote; USD 115,000 - 192,000; Full time

Benefits offered by this job

Comprehensive health plan

Disability insurance

Retirement benefits (SIP/ESPP)

Wellbeing initiatives

Tuition reimbursement

Job summary

Elsevier Senior Data Analyst III is sought to join a generative AI evaluation team focused on healthcare decision‑making tools. You will lead analytics frameworks, define evaluation methodologies, and drive the analytics roadmap for model performance and output quality.

You will collaborate with AI researchers, clinicians, product managers, and engineers to ensure accuracy, fairness, and regulatory compliance in health AI solutions.

Qualifications

• 6–9 years of relevant experience in data analytics
• Bachelor's degree required; Master's or PhD preferred in Mathematics/Science
• Demonstrated thought leadership in analytics strategy and enterprise‑wide project implementation
• Experience in a data analytics role
• Experience creating evaluation frameworks
• Proficiency in SQL Server, Snowflake or PostgreSQL; BI tools such as Tableau or Power BI; Python for analysis

Responsibilities

• Leading requirements gathering and development of analytics frameworks for evaluating generative AI models in healthcare applications
• Leading and defining the strategic direction for AI evaluation methodologies in their product area
• Managing the analytics roadmap for model evaluation
• Collaborating with internal and external stakeholders to manage evaluation timelines and deliverables
• Defining, developing, and deploying queries and metrics to assess AI model performance and output quality
• Leading data model creation and maintenance for AI evaluation frameworks and monitoring systems
• Conducting comprehensive QA of AI outputs and participating in risk analysis and mitigation
• Understanding how HIPAA and privacy laws affect AI deployment in healthcare
• Handling PHI and PII in AI contexts

Skills

Data analytics

Python

Thought leadership

Education

Bachelor's degree

Master's or PhD preferred

Tools

SQL Server

Snowflake

PostgreSQL

Tableau

Power BI

Job description

Elsevier Senior Data Analyst III is sought to join a generative AI evaluation team focused on healthcare decision‑making tools. You will lead analytics frameworks, define evaluation methodologies, and drive the analytics roadmap for model performance and output quality.

You will collaborate with AI researchers, clinicians, product managers, and engineers to ensure accuracy, fairness, and regulatory compliance in health AI solutions.