AI Benchmark Scientist: Biology PhD Coder

Mercor; Greater London; On-site; GBP 55,000 - 83,000; Part time

Job summary

Mercor is seeking PhD and Master’s level scientists to author AI evaluation tasks (Sci Code). You will create original, executable research problems that frontier models cannot solve and contribute to a new benchmark for scientific computing.

Work involves sourcing materials, writing prompts, building grading criteria, and calibrating against frontier models. This six-week, part-time engagement starts immediately and offers a collaborative, research-focused environment in which your work

Qualifications

• PhD in biology or related field.
• Depth in at least two subdomains: ecology, biochemistry, genetics.
• Working proficiency in Python, R, or another language for scientific computing.
• Comfortable with Git/GitHub and running code in Docker — PR workflow with automated checks.

Responsibilities

• Source your own material: a published paper, a Kaggle dataset, an open-source repository, or your own scenario.
• Write scientific prompts based on the input.
• Build the grading criteria that define a correct answer.
• Calibrate against frontier models — a task ships only when strong models fail it more often than they succeed.

Skills

Python

R

Scientific computing

Education

PhD in biology

MSc in biology

Tools

Git/GitHub

Docker

Job description

Mercor is seeking PhD and Master’s level scientists to author AI evaluation tasks (Sci Code). You will create original, executable research problems that frontier models cannot solve and contribute to a new benchmark for scientific computing.

Work involves sourcing materials, writing prompts, building grading criteria, and calibrating against frontier models. This six-week, part-time engagement starts immediately and offers a collaborative, research-focused environment in which your work