Data Science & Analysis - AI Training - San Francisco, US

prolificacademicltd; United States; Remote; USD 91,000 - 129,000; Full time

Benefits offered by this job

Remote work

Hourly pay up to $80

Job summary

Prolific Academic Ltd is seeking skilled data science researchers to evaluate AI-generated analyses and validate statistical reasoning on project-based tasks. You will run data scripts, review results, and ensure clarity and correctness of conclusions.

Assignments vary in length and pay up to $80 per hour. This remote, flexible role requires strong quantitative background and experience with large language models in data workflows.

Qualifications

• Bachelor’s, master’s or doctoral degree in data science, statistics, mathematics or a related quantitative field.
• Practical experience in data analysis, predictive modeling or machine learning engineering.
• Ability to solve challenging statistical problems and interpret complex visualizations independently.
• Careful attention to detail, including spotting flawed statistical reasoning.
• Substantial experience using large language models in data workflows and recognizing their limitations.
• Clear communication of mathematical concepts and data findings; a PayPal account is needed for payment.

Responsibilities

• Assess AI generated insights and statistical analyses for correctness, clarity and completeness.
• Verify mathematical claims, formulas and conclusions using reliable references.
• Run data scripts in Python or R to check results and edge cases.
• Identify strengths and weaknesses in model reasoning about statistics and predictive modeling.
• Check that responses follow task guidelines and professional standards.

Skills

Statistical reasoning

Data analysis

Independent problem solving

Attention to detail

LLM data workflows

Education

Bachelor’s/Master’s/PhD in quantitative field

Tools

Python

SQL

Tableau

Power BI

NumPy

Pandas

scikit-learn

Matplotlib/Seaborn

PyTorch

TensorFlow

Job description

Role overview

Apply data science or analytics expertise to help train and evaluate AI models through project based research tasks. Work includes checking statistical reasoning, reviewing generated analyses and validating code; candidates complete a short skills assessment before becoming eligible for tasks. Assignments vary in length, and some require an uninterrupted hour.

Responsibilities

• Assess AI generated insights and statistical analyses for correctness, clarity and completeness.
• Verify mathematical claims, formulas and conclusions using reliable references.
• Run data scripts in Python or R to check results and edge cases.
• Identify strengths and weaknesses in model reasoning about statistics and predictive modeling.
• Check that responses follow task guidelines and professional standards.

Requirements

• Bachelor’s, master’s or doctoral degree in data science, statistics, mathematics or a related quantitative field.
• Practical experience in data analysis, predictive modeling or machine learning engineering.
• Ability to solve challenging statistical problems and interpret complex visualizations independently.
• Careful attention to detail, including spotting flawed statistical reasoning.
• Substantial experience using large language models in data workflows and recognizing their limitations.
• Clear communication of mathematical concepts and data findings; a PayPal account is needed for payment.

Nice to have

• Python with Pandas, NumPy or scikit-learn, or R; advanced SQL; data visualization tools such as Tableau, Power BI, Matplotlib or Seaborn; and familiarity with machine learning frameworks such as PyTorch or TensorFlow.

Benefits and work setup

Tasks are remote and flexible, with compensation set by individual research projects. The source states that some researchers pay up to $80 per hour; rates and task availability may vary.