Remote Data Scientist: AI Evaluation & Analytics

prolificacademicltd; United States; Remote; USD 91,000 - 129,000; Full time

Job summary

Prolific Academic Ltd is seeking data science-oriented evaluators to review and validate data insights, run Python or R scripts, and verify statistical claims. You will assess model reasoning on predictive problems and document where the model adheres to or deviates from instructions.

The role emphasizes careful statistical judgment, independent interpretation of visualizations, and strong communication skills. Remote, task-based work with hourly pay can be flexible.

Qualifications

• Bachelor's, master's, or PhD in data science, statistics, mathematics, or another quantitative field.
• Real-world work in data analysis, predictive modeling, or machine learning engineering.
• Strong statistical problem-solving skills and ability to interpret advanced visualizations independently.
• Careful analytical judgement, including the ability to spot subtle errors in statistical arguments.
• Significant use of large language models in data workflows and knowledge of where they can fail.
• Clear communication, Python or R proficiency, advanced SQL, and a PayPal account for payment.
• Nice to have: experience with PyTorch or TensorFlow and related ML frameworks.

Responsibilities

• Review generated data insights and statistical work for accuracy, clarity, and completeness.
• Verify formulas, mathematical reasoning, and data-based claims against authoritative sources.
• Run Python or R scripts to confirm results and check behavior on edge cases.
• Evaluate model reasoning on data analysis and predictive modeling problems.
• Record whether outputs follow the technical and behavioral instructions for each task.

Skills

Python

R

SQL

Data analysis

Statistical reasoning

Communication

Education

Bachelor's degree in data science or related field

Master's degree in data science or related field

PhD in data science or related field

Tools

PyTorch

TensorFlow

Job description

Prolific Academic Ltd is seeking data science-oriented evaluators to review and validate data insights, run Python or R scripts, and verify statistical claims. You will assess model reasoning on predictive problems and document where the model adheres to or deviates from instructions.

The role emphasizes careful statistical judgment, independent interpretation of visualizations, and strong communication skills. Remote, task-based work with hourly pay can be flexible.