AI Training Data Scientist (Remote, Flexible)

Prolific; United States; Remote; USD 83,000 - 110,000; Full time

Benefits offered by this job

Flexible hours

Work from home

Competitive pay

Job summary

Prolific is seeking Data Scientists and Data Analysts to join its Expert Network for AI training and evaluation. You will review AI-generated data insights, validate statistical claims, and ensure results are accurate and reproducible.

Remote-friendly with flexible hours and hourly pay up to $80. Ideal candidates hold a BS, MS, or PhD in a quantitative field, with hands-on data analysis, modeling, and ML engineering experience. Proficiency in Python or R, SQL, and data visualization is expected.

Qualifications

• Education: a BS, MS, or PhD in Data Science, Statistics, Mathematics, or a closely related quantitative field.
• Professional experience: real-world experience in data analysis, predictive modeling, or machine learning engineering.
• Technical rigor: ability to solve complex statistical problems and interpret high-level data visualizations independently.
• Analytical mindset: strong attention to detail with ability to identify subtle logical fallacies in statistical reasoning or data interpretations.
• LLM fluency: significant experience using LLMs to assist with data workflows, with a clear understanding of where these models typically hallucinate or fail.
• Communication: ability to explain complex mathematical concepts or data insights clearly and concisely.
• A PayPal account to receive payment from our clients

Responsibilities

• Evaluate LLM responses: review AI-generated data insights and statistical analysis for accuracy, clarity, and completeness.
• Fact-check technical claims: use authoritative references to validate mathematical proofs, statistical formulas, and data-driven conclusions.
• Validate code & outputs: execute data-related scripts (e.g., Python/R) to ensure they produce correct results and handle edge cases properly.
• Annotate model performance: identify strengths and weaknesses in how a model reasons through data problems or builds predictive models.
• Ensure Alignment: verify that model responses follow specific system guidelines and maintain a high standard of professional technical behavior.

Skills

Data analysis

Predictive modeling

Machine learning engineering

Statistical reasoning

LLM fluency

Communication

Python

R

SQL

Data visualization

Education

BS in Data Science/Statistics/Math

MS in Data Science/Statistics/Math

PhD in a quantitative field

Tools

Python

R

SQL

Tableau

Power BI

Matplotlib/Seaborn

PyTorch

TensorFlow

Job description

Prolific is seeking Data Scientists and Data Analysts to join its Expert Network for AI training and evaluation. You will review AI-generated data insights, validate statistical claims, and ensure results are accurate and reproducible.

Remote-friendly with flexible hours and hourly pay up to $80. Ideal candidates hold a BS, MS, or PhD in a quantitative field, with hands-on data analysis, modeling, and ML engineering experience. Proficiency in Python or R, SQL, and data visualization is expected.