Remote AI Scientist: Chemistry Task Evaluator

Planet Pharma; San Francisco (CA); Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Fully remote

Flexible schedule

Job summary

Planet Pharma seeks experienced scientists and engineers to evaluate how frontier AI models handle real technical work. You design challenging tasks, analyze data, and judge model outputs against professional standards while assembling test plans, data analyses, and technical reports.

You will run tasks through frontier AI agents, grade results with detailed rubrics, and identify concrete failures with evidence. Strong coding and data analysis skills are essential for this fully remote role.

Qualifications

• Bachelor’s degree or higher; 2+ years of applied experience preferred in core sciences or data science.
• Hands-on with real data and analysis tools (Python, MATLAB, R, Excel).
• Strong written and spoken English; ability to articulate why a result is wrong.

Responsibilities

• Design realistic technical tasks drawn from day-to-day work and provide supporting files.
• Run tasks through frontier AI models and evaluate outputs against professional standards.
• Compare model outputs, justify which is better, and document gaps.

Skills

Python

Data analysis

Experiment design

Statistical reasoning

Communication

Education

Bachelor's degree or higher

Tools

Python

MATLAB

R

Excel

Google Workspace

Job description

Planet Pharma seeks experienced scientists and engineers to evaluate how frontier AI models handle real technical work. You design challenging tasks, analyze data, and judge model outputs against professional standards while assembling test plans, data analyses, and technical reports.

You will run tasks through frontier AI agents, grade results with detailed rubrics, and identify concrete failures with evidence. Strong coding and data analysis skills are essential for this fully remote role.