Remote Data Scientist for AI Training & Evaluation

Prolific; United States; Remote; USD 66,000 - 110,000; Full time

Benefits offered by this job

PayPal account

Flexible hours

Job summary

Prolific is seeking Data Scientists and Data Analysts to join its Expert Network to train and evaluate AI models, with paid tasks and a quick 10–15 minute test. Roles offer high-quality pay and flexible hours, with work-from-home options and international opportunities across a global participant pool.

Successful contributors will evaluate AI-generated insights, validate statistical claims, and help improve model performance while working remotely.

Qualifications

• Bachelor's, Master's, or PhD in a quantitative field (Data Science, Statistics, Mathematics)
• Real-world experience in data analysis, predictive modeling, or ML engineering
• Ability to solve complex statistical problems and interpret data visualizations
• Strong attention to detail and ability to spot subtle issues in data/logic
• Significant experience using LLMs to assist data workflows and awareness of common hallucinations
• Ability to explain complex mathematical concepts clearly to non-specialists
• PayPal account to receive payment from clients

Responsibilities

• Evaluate LLM responses for accuracy, clarity, and completeness
• Fact-check technical claims using authoritative references
• Validate code and outputs by running Python/R scripts and handling edge cases
• Annotate model performance by identifying strengths and weaknesses in reasoning
• Ensure alignment with system guidelines and maintain professional technical standards

Skills

Data analysis

Predictive modeling

Machine learning engineering

LLM integration

Statistical reasoning

Data visualization

Communication

Education

BS/MS/PhD in Data Science/Statistics/Mathematics or related

Tools

Python (Pandas, NumPy, Scikit-learn)

R

SQL

Tableau/PowerBI/Matplotlib/Seaborn

PyTorch/TensorFlow

Job description

Prolific is seeking Data Scientists and Data Analysts to join its Expert Network to train and evaluate AI models, with paid tasks and a quick 10–15 minute test. Roles offer high-quality pay and flexible hours, with work-from-home options and international opportunities across a global participant pool.

Successful contributors will evaluate AI-generated insights, validate statistical claims, and help improve model performance while working remotely.