Data Science & Analysis - AI Training - Washington DC, US

prolificacademicltd; United States; Remote; USD 91,000 - 129,000; Full time

Job summary

Prolific Academic Ltd is seeking data science-oriented evaluators to review and validate data insights, run Python or R scripts, and verify statistical claims. You will assess model reasoning on predictive problems and document where the model adheres to or deviates from instructions.

The role emphasizes careful statistical judgment, independent interpretation of visualizations, and strong communication skills. Remote, task-based work with hourly pay can be flexible.

Qualifications

• Bachelor's, master's, or PhD in data science, statistics, mathematics, or another quantitative field.
• Real-world work in data analysis, predictive modeling, or machine learning engineering.
• Strong statistical problem-solving skills and ability to interpret advanced visualizations independently.
• Careful analytical judgement, including the ability to spot subtle errors in statistical arguments.
• Significant use of large language models in data workflows and knowledge of where they can fail.
• Clear communication, Python or R proficiency, advanced SQL, and a PayPal account for payment.
• Nice to have: experience with PyTorch or TensorFlow and related ML frameworks.

Responsibilities

• Review generated data insights and statistical work for accuracy, clarity, and completeness.
• Verify formulas, mathematical reasoning, and data-based claims against authoritative sources.
• Run Python or R scripts to confirm results and check behavior on edge cases.
• Evaluate model reasoning on data analysis and predictive modeling problems.
• Record whether outputs follow the technical and behavioral instructions for each task.

Skills

Python

R

SQL

Data analysis

Statistical reasoning

Communication

Education

Bachelor's degree in data science or related field

Master's degree in data science or related field

PhD in data science or related field

Tools

PyTorch

TensorFlow

Job description

Role overview

Apply data science or analytics knowledge to paid AI evaluation tasks, helping improve the accuracy and quality of model responses. Work is project-based and may involve reviewing statistical outputs, validating code, and documenting where models reason well or fall short. A brief assessment is used to determine suitability.

Responsibilities

• Review generated data insights and statistical work for accuracy, clarity, and completeness.
• Verify formulas, mathematical reasoning, and data-based claims against authoritative sources.
• Run Python or R scripts to confirm results and check behavior on edge cases.
• Evaluate model reasoning on data analysis and predictive modeling problems.
• Record whether outputs follow the technical and behavioral instructions for each task.

Requirements

• A bachelor's, master's, or PhD in data science, statistics, mathematics, or another relevant quantitative field.
• Real-world work in data analysis, predictive modeling, or machine learning engineering.
• Strong statistical problem-solving skills and ability to interpret advanced visualizations independently.
• Careful analytical judgement, including the ability to spot subtle errors in statistical arguments.
• Significant use of large language models in data workflows and knowledge of where they can fail.
• Clear communication, Python or R proficiency, advanced SQL, and a PayPal account for payment.

Nice to have

• Experience with common data analysis and visualization libraries or tools, machine learning frameworks such as PyTorch or TensorFlow, and statistical modeling techniques.

Benefits and work setup

Tasks can be completed remotely with flexible hours. Some assignments need one uninterrupted hour; others are shorter. Rates are task-dependent and may be as high as $80 per hour. A short skills assessment precedes access to tasks.