Data Science & Analysis - AI Training - Portland, US

prolificacademicltd; United States; Remote; USD 34,000 - 83,000; Full time

Benefits offered by this job

Flexible, remote participation

Job summary

Prolific Academic Ltd. is seeking contributors to join a data science and analytics program that trains and evaluates AI models through paid, individual tasks. You will check model-generated statistical reasoning, data interpretations, and code for accuracy and usefulness. Some tasks require an uninterrupted hour.

Applicants complete a short skills assessment before invitation. Tasks vary in length and can be performed remotely, offering flexible participation and paid work on a per-task basis.

Qualifications

• Degree in data science, statistics, mathematics, or related quantitative field.
• Strong statistical problem-solving and data interpretation skills.
• Ability to spot subtle errors in statistical arguments and data interpretations.
• Experience using large language models in data workflows.

Responsibilities

• Assess AI-generated analyses for statistical accuracy, clarity, and completeness.
• Verify formulas, proofs, and data-based conclusions against reliable references.
• Run data scripts to check results, correctness, and handling of edge cases.
• Identify strengths and weaknesses in model reasoning about statistics and predictive modeling.
• Check that responses follow task guidelines and appropriate technical standards.

Skills

Statistical problem-solving

Interpret complex visualizations

Clear written communication

Experience with LLMs in data workflows

Education

Bachelor’s/Master’s/Doctoral in data science or related quantitative field

Tools

Python

R

SQL

Data visualization tools

Job description

Role overview

Contribute data science and analytics expertise to the training and evaluation of AI models through paid, individual tasks. The work focuses on checking whether model-generated statistical reasoning, data interpretations, and code are accurate and useful. Applicants complete a short skills assessment before being invited to participate; tasks vary in length, and some require an uninterrupted hour.

Responsibilities

• Assess AI-generated analyses for statistical accuracy, clarity, and completeness.
• Verify formulas, proofs, and data-based conclusions against reliable references.
• Run data scripts to check results, correctness, and handling of edge cases.
• Identify strengths and weaknesses in model reasoning about statistics and predictive modeling.
• Check that responses follow task guidelines and appropriate technical standards.

Requirements

• Bachelor’s, master’s, or doctoral degree in data science, statistics, mathematics, or a related quantitative field.
• Practical experience in data analysis, predictive modeling, or machine learning engineering.
• Strong statistical problem-solving skills and ability to interpret complex visualizations independently.
• Careful reasoning, including the ability to spot subtle errors in statistical arguments and data interpretations.
• Significant experience using large language models in data workflows, with awareness of their failure modes.
• Clear written communication of mathematical concepts and analytical findings.
• A PayPal account to receive task payments.

Nice to have

• Proficiency in Python or R; familiarity with common data and machine learning libraries and frameworks.
• Advanced SQL skills and experience with data visualization tools.
• Knowledge of statistical modeling and machine learning methods.

Benefits and work setup

Flexible, remote participation is described; tasks are paid, with some requiring one hour of uninterrupted work.