Remote AI Drug Discovery Task Designer and Evaluator

DataAnnotation

Foster City (CA)

Remote

USD 55,000 - 172,000

Part time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

DataAnnotation is seeking experienced drug discovery scientists to evaluate how frontier AI models handle real discovery and preclinical work, including SAR analysis, screening cascades, DMPK and PK/PD interpretation, biomarker strategy, and candidate selection. You will design realistic tasks, run them through frontier AI agents, and assess outputs against professional standards in a fully remote setting.

This role emphasizes clear written reasoning and technical depth, with long-form,

Qualifications

  • 3+ years hands-on in discovery or preclinical setting (pharma, biotech, or academic unit).
  • Strong written and verbal communication in English.
  • Ability to craft realistic scenarios to test AI systems and test quality.
  • Familiarity with AI and LLM tools in life sciences workflows.

Responsibilities

  • Design challenging, realistic drug discovery tasks drawn from your day-to-day workflows.
  • Run tasks through frontier AI agents and evaluate the outputs against professional standards.
  • Compare model outputs on identical prompts and document strengths and gaps.
  • Write detailed grading rubrics specifying content expectations and evaluation criteria.
  • Flag concrete failures with evidence such as data misreads or incorrect liabilities.

Skills

Attention to detail
Written communication
Critical thinking
Self-directed work

Education

Master's or PhD in Biology or related field

Tools

Claude/ChatGPT experience

Job description

DataAnnotation is seeking experienced drug discovery scientists to evaluate how frontier AI models handle real discovery and preclinical work, including SAR analysis, screening cascades, DMPK and PK/PD interpretation, biomarker strategy, and candidate selection. You will design realistic tasks, run them through frontier AI agents, and assess outputs against professional standards in a fully remote setting.

This role emphasizes clear written reasoning and technical depth, with long-form,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Drug Discovery Scientist: Task Design & Evaluation
Remote AI Drug Discovery Scientist: Task Design & Evaluation

DataAnnotation • Kodiak (AK)

Remote
USD 55,000 - 172,000
Remote AI Scientist, Drug Discovery Task Designer
Remote AI Scientist, Drug Discovery Task Designer

DataAnnotation • Tempe (AZ)

Remote
USD 55,000 - 172,000
Remote AI Scientist: Drug Discovery Task Designer
Remote AI Scientist: Drug Discovery Task Designer

DataAnnotation • Kenai (AK)

Remote
USD 55,000 - 172,000
Fully remote
Remote AI Scientist: Drug Discovery Task Design Evaluation
Remote AI Scientist: Drug Discovery Task Design Evaluation

DataAnnotation • Flagstaff (AZ)

Remote
USD 55,000 - 172,000
Remote AI Scientist: Drug Discovery Task Designer
Remote AI Scientist: Drug Discovery Task Designer

DataAnnotation • Peoria (AZ)

Remote
USD 55,000 - 172,000
Remote AI Trainer for Drug Discovery Excellence
Remote AI Trainer for Drug Discovery Excellence

DataAnnotation • Alabaster (AL)

Remote
USD 55,000 - 172,000
AI Scientist, Drug Discovery Task Designer (Remote)
AI Scientist, Drug Discovery Task Designer (Remote)

DataAnnotation • Morristown (VT)

Remote
USD 55,000 - 172,000
Fully remote
Remote AI Trainer — Drug Discovery & Lead Optimization
Remote AI Trainer — Drug Discovery & Lead Optimization

DataAnnotation • Sunnyvale (CA)

Remote
USD 55,000 - 172,000
Remote Life Sciences AI Trainer — Drug Discovery
Remote Life Sciences AI Trainer — Drug Discovery

DataAnnotation • Buckeye Township (IA)

Remote
USD 55,000 - 172,000
Senior Drug Discovery Scientist: AI Evaluation (Remote)
Senior Drug Discovery Scientist: AI Evaluation (Remote)

DataAnnotation • Kingman (AZ)

Remote
USD 55,000 - 172,000