Senior Data Analyst - AI Evaluation in Life Sciences

Elsevier; Gurugram District; On-site; INR 1,200,000 - 2,200,000; Full time

Benefits offered by this job

Group Health Insurance Policy (cover自自

Group Life insurance/accident policy

Generous long-service awards

New Baby gift

Subsidized food provided (India- CHENn

Casual Leave, Sick Leave, Privilege, M

Free Transport to/from office (India-)

Job summary

Elsevier is seeking a Senior Data Analyst - AI Evaluation to advance the assessment of AI-powered life sciences solutions. You will collaborate with scientists, product, and engineering teams to shape evaluation strategies and criteria reflecting customer needs and product goals.

In this role, you will tailor automated evaluation approaches, validate results, and identify gaps. You will build robust evidence to guide product improvements and faster feedback cycles.

Qualifications

• Experience evaluating AI or algorithmic outputs using scientific data.
• Experience applying scientific expertise in structured data environments like databases or knowledge graphs.
• Understanding how AI products access and use data, including data flows and APIs.
• Strong collaboration and clear communication across cross-functional teams.

Responsibilities

• Apply scientific expertise to contribute to customer-focused success criteria, evaluation rubrics, and acceptance criteria for AI solutions.
• Define evaluation scope, metrics, and scenarios using domain knowledge across life sciences and regulatory data.
• Build and curate scientific test sets reflecting real-world data usage.
• Adapt LLM-as-jury evaluation approaches to products, use cases, and metrics with domain experts.
• Conduct manual and automated evaluations of AI outputs, investigate discrepancies, and provide evidence-based feedback.
• Work with product, data science, and engineering to understand data access and interpretation by AI systems.
• Document evaluation findings, limitations, and recommendations for cross-functional teams.

Skills

Evaluation experience

Structured data

APIs & GitHub

Communication skills

Education

Life sciences degree (bioinformatics/cheminformatics/biochemistry/pharmacology)

Job description

Senior Data Analyst - AI Evaluation (Life Sciences)

Automate and conduct LLM-as-jury evaluations to improve AI-powered life sciences solutions through scientific expertise and rigorous analysis.

About our Team

We are a growing team working on the evaluation of AI systems in development and on cross-domain harmonization. Our mission is to enable better, more trustworthy AI-driven products by combining scientific expertise with rigorous evaluation and AI-ready data. We generate actionable evidence that accelerates product improvement, and we unlock greater value from curated scientific knowledge by making it interoperable, interpretable, and reliably usable by AI across domains.

About the Role

The Senior Data Analyst - AI Evaluation will support the evaluation of AI-powered solutions that use life sciences, chemistry, and regulatory data. Working with scientific domain experts, product, data science, and engineering teams, you will contribute to evaluation strategies and rubrics, evaluation scenarios, and acceptance criteria that reflect customer needs and product goals. A key focus of this role is adapting and validating automated evaluation approaches. Using an “LLM as jury” framework, you will tailor evaluation criteria and methods to specific products, use cases, and metrics. You will assess the reliability of automated judgments, identify gaps or inconsistencies, and refine the approach in collaboration with relevant experts. Through structured analysis, domain-informed judgment, and iterative validation you will contribute to more robust evidence of quality, faster feedback cycles for product development, and stronger alignment with real-world scientific and customer requirements.

Responsibilities

• Applying scientific expertise to contribute to customer-focused success criteria, evaluation rubrics, and acceptance criteria for AI solutions.
• Contributing to the definition of evaluation scope, metrics, and scenarios using domain knowledge across drug discovery, drug development, and regulatory approval.
• Building and curating scientific test sets and benchmarks that reflect real-world use of life sciences and regulatory data.
• Adapting LLM-as-jury evaluation approaches to specific products, use cases, and metrics, and validating and refining their performance in collaboration with scientific domain experts.
• Conducting manual and automated evaluations of AI outputs, investigating discrepancies and failure modes, and providing evidence-based feedback on evaluation quality.
• Working closely with product, data science, and engineering teams to understand how AI systems access, interpret, and use scientific data.
• Documenting evaluation findings, limitations, and recommendations clearly for cross-functional teams to support product improvements and release decisions.

Requirements

• Strong academic background in life sciences, such as bioinformatics, cheminformatics, biochemistry, pharmacology, or a related field.
• Experience evaluating AI or algorithmic outputs using scientific data.
• Experience applying scientific expertise in structured data or content environments, such as databases, taxonomies, knowledge graphs, or similar systems.
• Familiarity with how AI products access and use data, including a general understanding of data flows, APIs, and version-controlled workflows such as GitHub.
• Collaborative mindset and clear communication skills.

Work in a way that works for you

• We promote a healthy work/life balance across the organization. With an average length of service of 9 years, we are confident that we offer an appealing working prospect for our people. With numerous wellbeing initiatives, family leave and tuition reimbursement, we will help you meet your immediate responsibilities and long-term goals.
• Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive.

Working for you

• At Elsevier, we know that your wellbeing and happiness are key to a long and successful career.
• These are some of the benefits we are delighted to offer:

• Group Health Insurance Policy (covering self and family)
• Group Life insurance/accident policy
• Generous long-service awards
• New Baby gift
• Subsidized food provided (applies to India- Chennai)
• Casual Leave, Sick Leave, Privilege Leave, Compassionate Leave, Special Sick Leave, Gazetted Public Holiday and Maternity/Paternity Leave
• Free Transport provided to and from the office (applies to India-Chennai)

About Us

A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world’s . We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.USA Job Seekers: EEO Know Your Rights .

Experience Level Senior Level