Life Sciences Researcher (AI Evaluation)

Gramian Consulting Group; United States; Remote; USD 55,000 - 96,000; Part time

Job summary

Gramian Consulting Group seeks experienced Life Sciences researchers to design advanced scientific reasoning tasks for an AI evaluation benchmark. This is a non-coding contractor role for 6 weeks, remote work open to qualified candidates in multiple countries.

The work focuses on creating self-contained problems from experiments, data, figures, literature evidence, and scenarios, aiming to test genuine scientific interpretation and synthesis.

Qualifications

• PhD, postdoctoral experience, or equivalent advanced research in the Life Sciences.
• Deep expertise in at least one biological discipline.
• Strong ability to interpret experiments, data and research findings.
• Excellent written and oral communication for writing tasks and explanations.

Responsibilities

• Design challenging life-sciences reasoning problems for AI evaluation.
• Create tasks using realistic experiments, datasets, figures, sequences, and literature-style evidence.
• Write questions with clear, defensible answers.
• Develop expert reference answers detailing the required reasoning.
• Ensure tasks test interpretation and synthesis over recall.
• Validate biological claims, calculations, assumptions, and conclusions.
• Identify ambiguity and alternative valid interpretations.
• Build tasks that differentiate advanced AI models by reasoning ability.
• Incorporate reviewer feedback while maintaining quality and throughput.
• Document tasks clearly and reproducibly where applicable.

Skills

Biology expertise

Experimental design

Scientific reasoning

Data interpretation

Education

PhD or equivalent advanced research experience

Job description

Role Overview

We are looking for experienced Life Sciences researchers and subject‑matter experts to create advanced scientific reasoning tasks for an AI evaluation benchmark focused on biology and related disciplines.

This is a non‑coding research role. The work centers on designing rigorous, self‑contained scientific problems based on realistic experiments, biological data, figures, sequences, structures, literature‑style evidence, and research scenarios. The goal is to create tasks that test whether AI systems can genuinely interpret evidence, reason scientifically, and synthesize information, rather than simply recall facts.

Relevant backgrounds include Molecular Biology, Genetics & Genomics, Cell Biology, Biochemistry, Neuroscience, Microbiology, Immunology, Evolutionary Biology, Ecology, Structural Biology, Biophysics, Developmental Biology, Cancer Biology, Pharmacology, and related fields.

CONTRACT: Contractor assignment, 6 weeks

COMMITMENT: Hourly, up to 40h/week

LOCATIONS: Remote - Argentina, Bangladesh, Brazil, Colombia, Egypt, Nigeria , Ghana, India, Indonesia, Turkey, Vietnam, Kenya, Pakistan, Chile, Peru, Sri Lanka, Saudi Arabia, Nepal, Mexico

PROCESS: Application form > 60 min online test (analyzing biochemical measurements and distinguishing among mechanistic defects in enzyme variants)

Key Responsibilities

• Design challenging life‑sciences reasoning problems for AI evaluation.

• Create tasks based on realistic experiments, biological datasets, figures, sequences, structures, and scientific evidence.

• Write questions with clear, objectively defensible answers.

• Develop rigorous expert reference answers explaining the required scientific reasoning.

• Ensure tasks test interpretation and synthesis, not simple factual recall.

• Validate biological claims, calculations, assumptions, and conclusions.

• Identify ambiguity, alternative valid interpretations, and poorly constrained questions.

• Build tasks that meaningfully differentiate advanced AI models based on scientific reasoning ability.

• Incorporate reviewer feedback while maintaining high quality and throughput.

• Document tasks clearly and reproducibly where applicable.

• PhD, postdoctoral experience, or equivalent advanced research experience in the Life Sciences.

• Deep expertise in at least one biological discipline.

• Strong ability to interpret scientific experiments, data, and research findings.

• Strong understanding of experimental design and scientific reasoning.