Biochemist for AI Benchmark Tasks & Prompt Design

Mercor; San Francisco (CA); Remote; USD 96,000 - 138,000; Part time

Job summary

Mercor is hiring PhD and Master’s scientists to author AI evaluation tasks for Sci Code. You will design original, executable research problems that today’s frontier models cannot solve.

Source your own material, write scientific prompts, build grading criteria, and calibrate against frontier models. Tasks ship only when strong models fail it more often than they succeed, with Docker runs and PR-based quality checks.

Qualifications

• PhD in biology, biological sciences, biochemistry, genetics, ecology, or a closely related field.

Responsibilities

• Source your own material: a published paper, a Kaggle dataset, an open-source repository, or a scenario you design.
• Write scientific prompts based on the input
• Build the grading criteria that define a correct answer
• Calibrate against frontier models — a task ships only when strong models fail it more often than they succeed

Skills

Python

R

Git/GitHub

Education

PhD in Biology/Related Field

Master's in Biology/Related Field

Tools

Docker

Job description

Mercor is hiring PhD and Master’s scientists to author AI evaluation tasks for Sci Code. You will design original, executable research problems that today’s frontier models cannot solve.

Source your own material, write scientific prompts, build grading criteria, and calibrate against frontier models. Tasks ship only when strong models fail it more often than they succeed, with Docker runs and PR-based quality checks.