Frontier AI Data Scientist: Task Design & Evaluation

Planet Pharma; San Francisco (CA); On-site; USD 120,000 - 190,000; Full time

Job summary

Planet Pharma is seeking an AI Trainer – Data Science in San Francisco, CA. You will design and evaluate realistic data science tasks, assess frontier AI model outputs, and develop grading rubrics to ensure high-quality decisions. The role emphasizes written reasoning, exploratory analyses, and self-directed, long-form work.

The position is on-site in San Francisco with direct hire/permanent employment and a strong emphasis on practical applied work in AI and data science.

Qualifications

• 2+ years of professional applied data science experience in industry or research.
• Working proficiency in Python and/or SQL.
• Depth in at least one area: analytics/BI, ML, statistics/experimentation, forecasting, data engineering, NLP or CV.
• Own end-to-end multi-step analysis from raw data to interpretation and decision.

Responsibilities

• Design realistic data science tasks drawn from your day-to-day work.
• Run tasks through frontier AI models and evaluate deliverables against standards.
• Compare model outputs and document performance gaps.
• Write detailed grading rubrics and tests for correct deliverables.
• Flag failures with evidence such as leakage or confounding and provide rationale.

Skills

Python

SQL

Data Science

Experimentation

Analytics

Education

Bachelor’s degree in quantitative field

Advanced degree is a plus

Tools

Notebook tools

Job description

Planet Pharma is seeking an AI Trainer – Data Science in San Francisco, CA. You will design and evaluate realistic data science tasks, assess frontier AI model outputs, and develop grading rubrics to ensure high-quality decisions. The role emphasizes written reasoning, exploratory analyses, and self-directed, long-form work.

The position is on-site in San Francisco with direct hire/permanent employment and a strong emphasis on practical applied work in AI and data science.