AI Training Data Scientist & Analyst — Remote Work

Prolific; United States; Remote; USD 55,000 - 110,000; Full time

Benefits offered by this job

PayPal account to receive payment

Flexible hours

Work from home

Job summary

Prolific is seeking Data Scientists and Data Analysts to join our Expert Network to train and evaluate AI models using real technical expertise. A 10–15 minute test assesses your skills; if successful, you’ll be invited to join Prolific as a participant, paid to train and evaluate AI models.

Expect to evaluate LLM responses, fact-check technical claims, validate code outputs, annotate model performance, and ensure alignment with guidelines.

Qualifications

• BS, MS, or PhD in Data Science, Statistics, Mathematics, or related quantitative field.
• Real-world experience in data analysis, predictive modeling, or ML engineering.
• Ability to solve complex statistical problems and interpret data visualizations.
• Strong attention to detail and ability to identify logical fallacies in data interpretations.
• Significant experience using LLMs to assist with data workflows and understand hallucinations/failures.
• Clear and concise communication of complex mathematical concepts or data insights.
• Must have a PayPal account to receive payment from clients.

Responsibilities

• Evaluate LLM responses for accuracy and completeness.
• Fact-check technical claims using authoritative references.
• Validate code and outputs to ensure correct results and edge-case handling.
• Annotate model performance by identifying strengths and weaknesses in model reasoning.
• Ensure model responses follow system guidelines and maintain professional technical standards.

Skills

Education planning

Data analysis

Predictive modeling

Machine learning

LLM fluency

Communication

PayPal payment

Education

BS/MS/PhD in Data Science/Statistics/Math

Tools

Python

R

SQL

Tableau/PowerBI/Matplotlib/Seaborn

PyTorch/TensorFlow

Job description

Prolific is seeking Data Scientists and Data Analysts to join our Expert Network to train and evaluate AI models using real technical expertise. A 10–15 minute test assesses your skills; if successful, you’ll be invited to join Prolific as a participant, paid to train and evaluate AI models.

Expect to evaluate LLM responses, fact-check technical claims, validate code outputs, annotate model performance, and ensure alignment with guidelines.