Remote Data Scientist - AI Training & Evaluation

Prolific Academic Ltd; United States; Remote; USD 55,000 - 110,000; Full time

Job summary

Prolific seeks Data Scientists and Data Analysts to join our Expert Network to train and evaluate AI models using real technical expertise. A quick test may be required; successful candidates join Prolific as paid participants, with the ability to work from home.

Researchers paying up to $80 per hour expect 1 hour of uninterrupted work per task, with many tasks shorter. You’ll bring a strong background in data science and ML, plus hands-on Python/R and SQL skills.

Qualifications

• Education: a BS, MS, or PhD in Data Science, Statistics, Mathematics, or a closely related quantitative field.
• Professional Experience: real-world experience in data analysis, predictive modeling, or machine learning engineering.
• Technical Rigor: solve complex statistical problems and interpret data visualizations independently.
• Analytical Mindset: attention to detail and spotting logical fallacies in data interpretations.
• LLM Fluency: extensive use of LLMs to assist data workflows and awareness of model fail cases.
• Communication: explain complex mathematical concepts clearly and concisely.
• Paypal: have a PayPal account to receive payment from our clients.

Responsibilities

• Evaluate LLM responses: review AI-generated data insights for accuracy, clarity, and completeness.
• Fact-check technical claims: validate mathematical proofs, formulas, and data-driven conclusions with references.
• Validate code & outputs: run Python/R scripts to ensure correctness and handle edge cases.
• Annotate model performance: identify strengths/weaknesses in model reasoning for data problems.
• Ensure alignment: verify model responses follow system guidelines and maintain professional behavior.

Skills

Data analysis

Predictive modeling

ML engineering

Statistical reasoning

LLM workflows

Communication

Python

R

SQL

Education

BS/MS/PhD in Data Science/Statistics/Math

Tools

Python (Pandas/NumPy/Scikit-learn)

R

SQL

Tableau/PowerBI

Matplotlib/Seaborn

PyTorch/TensorFlow

Job description

Prolific seeks Data Scientists and Data Analysts to join our Expert Network to train and evaluate AI models using real technical expertise. A quick test may be required; successful candidates join Prolific as paid participants, with the ability to work from home.

Researchers paying up to $80 per hour expect 1 hour of uninterrupted work per task, with many tasks shorter. You’ll bring a strong background in data science and ML, plus hands-on Python/R and SQL skills.