Remote AI Chemistry Task Designer and Evaluator

Planet Pharma

San Francisco (CA)

Remote

USD 120,000 - 180,000

Full time

4 days ago
Be an early applicant
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Planet Pharma seeks experienced scientists and engineers to design and evaluate frontier AI models on real technical work, from data analysis to design verifications and reporting. Tasks are grounded in authentic practice and checked against professional standards, with a focus on coding and scientific computing where applicable.

You will craft realistic task packages, run them through frontier AI agents, and assess outputs for accuracy, assumptions, and proper methodology.

Qualifications

  • 2+ years of applied experience preferred in one of the core sciences (math, physics, chemistry, or biology) or in an engineering discipline or in data science.
  • In progress Bachelor’s degree or higher; 2+ years outside undergrad preferred.
  • Coding/scientific computing: comfortable writing and verifying work in code (Python or similar) and using the command line.

Responsibilities

  • Design challenging, realistic technical tasks drawn from your day-to-day work with supporting files.
  • Run tasks through frontier AI models and evaluate deliverables against professional standards.
  • Compare model outputs on identical prompts and documents, and document strengths/weaknesses.
  • Write detailed grading rubrics and explain why responses pass or fail.
  • Flag concrete failures with evidence (unit/scale errors, data read issues, unsupported conclusions).
  • Review and refine tasks built by other experts across disciplines.

Skills

Python
Statistical reasoning
Experiment design
Data analysis
Technical writing

Education

Bachelor's degree or higher

Tools

MATLAB
R
SPICE
PCB tools

Job description

Planet Pharma seeks experienced scientists and engineers to design and evaluate frontier AI models on real technical work, from data analysis to design verifications and reporting. Tasks are grounded in authentic practice and checked against professional standards, with a focus on coding and scientific computing where applicable.

You will craft realistic task packages, run them through frontier AI agents, and assess outputs for accuracy, assumptions, and proper methodology.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Evaluation Engineer
Remote AI Evaluation Engineer

Planet Pharma • San Francisco (CA)

Remote
USD 120,000 - 180,000
Remote AI Legal Evaluator & Task Designer
Remote AI Legal Evaluator & Task Designer

Planet Pharma • San Francisco (CA)

Remote
USD 140,000 - 190,000
AI Task Architect for Real-World STEM & Biology
AI Task Architect for Real-World STEM & Biology

Planet Pharma • San Francisco (CA)

Remote
USD 120,000 - 180,000
Remote AI Mech Eng Task Designer & Evaluator
Remote AI Mech Eng Task Designer & Evaluator

Planet Pharma • San Francisco (CA)

Remote
USD 90,000 - 150,000
Remote AI Validation Scientist – Physics
Remote AI Validation Scientist – Physics

Planet Pharma • San Francisco (CA)

Remote
USD 60,000 - 110,000
Remote Clinical AI Evaluator & Task Designer
Remote Clinical AI Evaluator & Task Designer

Planet Pharma • San Francisco (CA)

Remote
USD 120,000 - 180,000
Remote AI Accounting Evaluator & Task Designer
Remote AI Accounting Evaluator & Task Designer

Planet Pharma • San Francisco (CA)

Remote
USD 120,000 - 180,000
Remote AI Chemistry Prompt Architect
Remote AI Chemistry Prompt Architect

DataAnnotation • California (MO)

Remote
USD 55,000 - 172,000
Flexible schedule
Remote work
Remote AI Chemistry Safety Evaluator & Prompt Engineer
Remote AI Chemistry Safety Evaluator & Prompt Engineer

DataAnnotation • Maine

Remote
USD 55,000 - 172,000
Remote work
Remote AI Chemistry Reviewer and Prompt Engineer
Remote AI Chemistry Reviewer and Prompt Engineer

DataAnnotation • Maryland

Remote
USD 55,000 - 172,000
Flexible schedule
Remote work
Project-based income