Senior Data Analyst: AI Evaluation (Life Sciences)

Elsevier; City Of London; On-site; GBP 65,000 - 100,000; Full time

Benefits offered by this job

Health insurance

Life insurance

Long-service awards

Baby gift

Subsidized food

Generous leave policy

Transport provided

Job summary

Elsevier invites applications for a Senior Data Analyst - AI Evaluation role focused on evaluating AI-powered life sciences solutions using LLM-as-jury methods. You will develop evaluation rubrics, adapt automated approaches, and validate results with scientific domain experts to ensure robust evidence for product decisions.

The role partners with product, data science, and engineering teams to shape evaluation strategies, datasets, and acceptance criteria that reflect real-world scientific and

Qualifications

• Strong academic background in life sciences, such as bioinformatics, cheminformatics, biochemistry, pharmacology, or a related field.
• Experience evaluating AI or algorithmic outputs using scientific data.
• Experience applying scientific expertise in structured data or content environments, such as databases, taxonomies, knowledge graphs, or similar systems.
• Familiarity with how AI products access and use data, including a general understanding of data flows, APIs, and version-controlled workflows such as GitHub.
• Collaborative mindset and clear communication skills.

Responsibilities

• Applying scientific expertise to contribute to customer-focused success criteria, evaluation rubrics, and acceptance criteria for AI solutions.
• Contributing to the definition of evaluation scope, metrics, and scenarios using domain knowledge across drug discovery, drug development, and regulatory approval.
• Building and curating scientific test sets and benchmarks that reflect real-world use of life sciences and regulatory data.
• Adapting LLM-as-jury evaluation approaches to specific products, use cases, and metrics, and validating and refining their performance in collaboration with scientific domain experts.
• Conducting manual and automated evaluations of AI outputs, investigating discrepancies and failure modes, and providing evidence-based feedback on evaluation quality.
• Working closely with product, data science, and engineering teams to understand how AI systems access, interpret, and use scientific data.
• Documenting evaluation findings, limitations, and recommendations clearly for cross-functional teams to support product improvements and release decisions.

Skills

AI evaluation experience

Life sciences data

Collaborative work

Data workflows

Education

Life sciences background

Tools

GitHub

APIs

Knowledge graphs

Job description

Elsevier invites applications for a Senior Data Analyst - AI Evaluation role focused on evaluating AI-powered life sciences solutions using LLM-as-jury methods. You will develop evaluation rubrics, adapt automated approaches, and validate results with scientific domain experts to ensure robust evidence for product decisions.

The role partners with product, data science, and engineering teams to shape evaluation strategies, datasets, and acceptance criteria that reflect real-world scientific and