Senior Data Analyst III — AI Model Evaluation (Healthcare)

RXinsider LTD.; New York (NY); On-site; USD 126,000 - 210,000; Full time

Benefits offered by this job

Comprehensive health plan

Disability insurance

Dependent Care and Commuter Spending

Life and Accident Insurance

Retirement Benefits (Salary Investment

Employer Stock Purchase Plan

Modern Family Benefits (adoption/surro

Job summary

Elsevier seeks a data analytics professional to join its generative AI evaluation team focused on healthcare decision-support tools. You will evaluate model performance, analyze outputs, and ensure alignment with clinical relevance and safety standards.

Role requires experience in evaluating AI models, developing analytics frameworks, and collaborating with researchers, product managers, clinicians, and engineers to improve model performance in healthcare contexts.

Qualifications

• 6-9 years of relevant experience in data analytics.
• Bachelor's Degree Required, Master's Or PhD Preferred In Mathematics/Science.
• Demonstrated thought leadership in analytics strategy and enterprise-wide project implementation.
• Have experience in a data analytics role.
• Have expertise in creating evaluation frameworks.
• Have expertise in using and querying relational database management systems such as Microsoft SQL Server, Snowflake or postgreSQL
• Have expertise in using BI tools such as Tableau or PowerBI
• Be able to demonstrate experience using Python for analysis

Responsibilities

• Leading requirements gathering and development of analytics frameworks for evaluating generative AI models in healthcare applications
• Leading and defining the strategic direction for AI evaluation methodologies in their product area
• Managing the analytics roadmap for model evaluation. Collaborating with internal and external stakeholders to manage evaluation timelines and deliverables
• Defining, developing, and deploying queries and metrics to assess AI model performance and output quality
• Leading data model creation and maintenance for AI evaluation frameworks and monitoring systems
• Conducting comprehensive QA of AI outputs and participating in risk analysis and mitigation
• Understanding how security and privacy laws such as HIPAA affect AI deployment in healthcare. Understanding how to handle sensitive data including PHI and PII in AI contexts

Skills

Data analytics

Python

Analytics strategy

Education

Bachelor's degree

Master's or PhD in Mathematics/Science

Tools

Microsoft SQL Server

Snowflake

PostgreSQL

Tableau

Power BI

Job description

Elsevier seeks a data analytics professional to join its generative AI evaluation team focused on healthcare decision-support tools. You will evaluate model performance, analyze outputs, and ensure alignment with clinical relevance and safety standards.

Role requires experience in evaluating AI models, developing analytics frameworks, and collaborating with researchers, product managers, clinicians, and engineers to improve model performance in healthcare contexts.