AI Model Trainer & Evaluator (Remote)

Prolific; United States; Remote; USD 55,000 - 110,000; Full time

Benefits offered by this job

Flexible hours

Work from home

Job summary

Prolific is seeking data scientists and data analysts to join its Expert Network, helping train and evaluate AI models with real technical expertise. You'll complete a short test to assess fit and may join Prolific as a paid participant.

Researchers pay up to $80 per hour for tasks requiring focused, uninterrupted work; many tasks are shorter and can be completed from home with flexible hours.

Qualifications

• Education in a quantitative field (BS/MS/PhD).
• Real-world experience in data analysis, predictive modeling, or ML engineering.
• Ability to solve complex statistical problems and interpret high-level data visualizations.
• Strong analytical mindset with attention to detail and critical thinking.
• Significant experience using LLMs to assist data workflows and recognizing model limitations.

Responsibilities

• Evaluate AI-generated data insights for accuracy and clarity.
• Fact-check technical claims using authoritative references.
• Validate code and outputs with scripts in Python/R.
• Annotate model performance and identify strengths/weaknesses.
• Ensure model responses align with system guidelines and professional standards.

Skills

Data analysis

Predictive modeling

Machine learning engineering

Statistical reasoning

LLM fluency

Data visualization

Communication

Education

BS/MS/PhD in Data Science/Statistics/Mathematics

Tools

Python (Pandas/NumPy/Scikit-learn)

R

SQL

Tableau

PowerBI

Matplotlib/Seaborn

PyTorch/TensorFlow

Job description

Prolific is seeking data scientists and data analysts to join its Expert Network, helping train and evaluate AI models with real technical expertise. You'll complete a short test to assess fit and may join Prolific as a paid participant.

Researchers pay up to $80 per hour for tasks requiring focused, uninterrupted work; many tasks are shorter and can be completed from home with flexible hours.