AI Task Design & Evaluation Scientist (Remote)

DataAnnotation

Avondale (AZ)

Remote

USD 55,000 - 172,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

DataAnnotation in the United States seeks experienced bench scientists to design realistic biology tasks for frontier AI assessment. You will craft scenarios from your own practice—cell-based assays, cloning checks, Western blot interpretations—and judge AI outputs against high professional standards in a fully remote setting.

The role emphasizes clear written reasoning, detailed task rubrics, and the ability to compare model performances.

Qualifications

  • Master's or PhD, or current PhD candidate, in Biology or related field, completed in U.S./Canada/Europe/UK.
  • 3+ years designing and running experiments in pharma/biotech or academic labs.
  • Hands-on practitioner: bench work or analysis, not only SOPs.
  • Excellent written and spoken English; ability to explain complex reasoning clearly.

Responsibilities

  • Design realistic experimental biology tasks drawn from day-to-day workflows.
  • Run tasks through frontier AI agents and evaluate their deliverables against professional standards.
  • Compare two model outputs and document which performed better and why.
  • Write detailed grading rubrics and explain pass/fail criteria.
  • Flag concrete failures with evidence (controls, outliers, incorrect interpretations).
  • Contribute across multiple biology fields and help refine tasks built by other experts.

Skills

Bench experience
English prose
Attention to detail
Interpreting feedback
AI/LLM familiarity
Tech literacy
Remote self-direction
Availability 10+ hrs/wk

Education

Master's or PhD in Biology or related field

Tools

Claude/ChatGPT
Google Workspace

Job description

DataAnnotation in the United States seeks experienced bench scientists to design realistic biology tasks for frontier AI assessment. You will craft scenarios from your own practice—cell-based assays, cloning checks, Western blot interpretations—and judge AI outputs against high professional standards in a fully remote setting.

The role emphasizes clear written reasoning, detailed task rubrics, and the ability to compare model performances.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Lab Task Architect & Evaluator
Remote AI Lab Task Architect & Evaluator

DataAnnotation • Yuma (AZ)

Remote
USD 55,000 - 172,000
Remote Life Sciences AI Evaluator & Task Designer
Remote Life Sciences AI Evaluator & Task Designer

DataAnnotation • Prescott Township (IA)

Remote
USD 55,000 - 172,000
Remote Life Sciences AI Evaluation Scientist
Remote Life Sciences AI Evaluation Scientist

DataAnnotation • Mountain View (CA)

Remote
USD 55,000 - 172,000
Remote contract role
Remote AI Lab Evaluator for Experimental Biology
Remote AI Lab Evaluator for Experimental Biology

DataAnnotation • Moscow

Remote
USD 55,000 - 172,000
AI Validation Scientist, Life Sciences (Remote)
AI Validation Scientist, Life Sciences (Remote)

DataAnnotation • Fairhope (AL)

Remote
USD 55,000 - 172,000
Senior Life Sciences AI Evaluation Scientist (Remote)
Senior Life Sciences AI Evaluation Scientist (Remote)

DataAnnotation • Huntsville (AL)

Remote
USD 55,000 - 172,000
Remote Experimental Biologist for AI Evaluation
Remote Experimental Biologist for AI Evaluation

Society for Neuroscience • United States

Remote
USD 55,000 - 172,000
AI Validation Scientist
AI Validation Scientist

DataAnnotation • State College

Remote
USD 55,000 - 172,000
Fully remote
Flexible scheduling
PayPal payments
AI Evaluation Specialist — Computational Biology (Remote)
AI Evaluation Specialist — Computational Biology (Remote)

DataAnnotation • Newark (NJ)

Remote
USD 55,000 - 172,000
Fully remote
Flexible scheduling
Office hours onboarding
Remote AI Bioinformatics Trainer & Model Evaluator
Remote AI Bioinformatics Trainer & Model Evaluator

DataAnnotation • Clemson (SC)

Remote
USD 55,000 - 172,000