Remote Experimental Biologist for AI Evaluation

Society for Neuroscience; United States; Remote; USD 55,000 - 172,000; Part time

Job summary

DataAnnotation is seeking experienced bench scientists to design and run AI-lab evaluation tasks, grading model outputs against professional standards.

You will create realistic experimental biology tasks, run them through frontier AI agents, compare results, and write detailed rubrics and justifications to improve model reliability. Remote, contract, 10+ hours weekly. Strong written communication and domain knowledge in biology are required.

Qualifications

• Master’s or PhD in Biology or related field (or current PhD candidate).
• Experience designing and troubleshooting experiments.
• Ability to generate and QC primary data and assess raw outputs.

Responsibilities

• Design realistic experimental biology tasks drawn from daily workflows.
• Run tasks through frontier AI agents and evaluate outputs against standards.
• Compare model outputs and document performance differences.
• Write detailed grading rubrics and explain pass/fail criteria.
• Flag concrete failures with evidence and insights.

Skills

Experiment design

Troubleshooting

Data reading

Scientific reasoning

English writing

Education

Master’s or PhD in Biology or related field

Tools

Google Workspace

Claude

ChatGPT

Job description

DataAnnotation is seeking experienced bench scientists to design and run AI-lab evaluation tasks, grading model outputs against professional standards.

You will create realistic experimental biology tasks, run them through frontier AI agents, compare results, and write detailed rubrics and justifications to improve model reliability. Remote, contract, 10+ hours weekly. Strong written communication and domain knowledge in biology are required.