Remote AI Lab Task Architect & Evaluator

DataAnnotation

Yuma (AZ)

Remote

USD 55,000 - 172,000

Part time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

DataAnnotation is seeking experienced bench scientists to design realistic, data-rich exercises that test how frontier AI models handle genuine laboratory tasks. You will create scenarios, evaluate AI-generated results, and document performance with precise rubrics.

This is a fully remote, contract-based role requiring strong scientific judgment and clear written reasoning. The work spans molecular biology, cell biology, and related disciplines, and you will assess AI outputs against

Qualifications

  • 3+ years designing and running experiments in biology.
  • Experience evaluating workflows in pharma/biotech or academic labs.
  • Ability to craft scenarios testing AI system capabilities and training rubrics.
  • Able to explain complex reasoning and diagnose why a run failed.
  • Hands-on bench or analysis work at IC level, not just management.

Responsibilities

  • Design challenging, realistic biology tasks drawn from your day-to-day workflows.
  • Run tasks through frontier AI agents and evaluate deliverables against standards.
  • Compare two model outputs and document performance gaps.
  • Write detailed grading rubrics and justify pass/fail decisions.
  • Flag concrete failures with evidence and verify data integrity.

Skills

Experimental design
Data interpretation
Technical writing
Attention to detail
Remote collaboration

Education

Master's or PhD in Biology or related field

Tools

Claude
ChatGPT
Google Workspace

Job description

DataAnnotation is seeking experienced bench scientists to design realistic, data-rich exercises that test how frontier AI models handle genuine laboratory tasks. You will create scenarios, evaluate AI-generated results, and document performance with precise rubrics.

This is a fully remote, contract-based role requiring strong scientific judgment and clear written reasoning. The work spans molecular biology, cell biology, and related disciplines, and you will assess AI outputs against

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Lab Evaluator for Experimental Biology
Remote AI Lab Evaluator for Experimental Biology

DataAnnotation • Moscow

Remote
USD 55,000 - 172,000
AI Task Design & Evaluation Scientist (Remote)
AI Task Design & Evaluation Scientist (Remote)

DataAnnotation • Avondale (AZ)

Remote
USD 55,000 - 172,000
Remote Life Sciences AI Evaluator & Task Designer
Remote Life Sciences AI Evaluator & Task Designer

DataAnnotation • Prescott Township (IA)

Remote
USD 55,000 - 172,000
Remote Life Sciences AI Evaluation Scientist
Remote Life Sciences AI Evaluation Scientist

DataAnnotation • Mountain View (CA)

Remote
USD 55,000 - 172,000
Remote contract role
Remote Experimental Biologist for AI Evaluation
Remote Experimental Biologist for AI Evaluation

Society for Neuroscience • United States

Remote
USD 55,000 - 172,000
Remote Life Sciences AI QA Specialist
Remote Life Sciences AI QA Specialist

DataAnnotation • Palo Alto (CA)

Remote
USD 55,000 - 172,000
Pay via PayPal
Fully remote
Flexible scheduling
Senior Life Sciences AI Evaluation Scientist (Remote)
Senior Life Sciences AI Evaluation Scientist (Remote)

DataAnnotation • Huntsville (AL)

Remote
USD 55,000 - 172,000
Remote AI Bioinformatics Trainer & Model Evaluator
Remote AI Bioinformatics Trainer & Model Evaluator

DataAnnotation • Clemson (SC)

Remote
USD 55,000 - 172,000
AI Validation Scientist
AI Validation Scientist

DataAnnotation • State College

Remote
USD 55,000 - 172,000
Fully remote
Flexible scheduling
PayPal payments
AI Validation Scientist, Life Sciences (Remote)
AI Validation Scientist, Life Sciences (Remote)

DataAnnotation • Fairhope (AL)

Remote
USD 55,000 - 172,000