AI Model Evaluator & Data Scientist — Remote

prolificacademicltd; United States; Remote; USD 55,000 - 110,000; Full time

Job summary

prolificacademicltd seeks data science and analytics experts to take on paid assignments evaluating AI models. You review technical answers, check code and quantitative claims, and provide structured feedback on performance. A short skills assessment precedes invitations to participate.

The role is listed for Indianapolis, US. Responsibilities include judging accuracy of AI-generated analyses, validating statistical claims, running data scripts, and describing model strengths and weaknesses.

Qualifications

• Bachelor’s, Master’s or PhD in a quantitative field.
• Experience in data analysis, predictive modelling or ML engineering.
• Ability to interpret complex statistical questions and visualisations.
• Strong attention to detail and ability to detect faulty interpretations.
• Experience applying LLMs to data workflows.
• Clear communication of mathematical ideas; PayPal account required for payment.

Responsibilities

• Judge the accuracy, completeness, and clarity of AI-generated statistical analysis and data insights.
• Validate mathematical and statistical claims using dependable references.
• Execute data scripts to check outputs and identify problems with edge cases.
• Describe model strengths and weaknesses when handling analytical or predictive tasks.
• Confirm that model responses meet the directions and professional standards set for each assignment.

Skills

Data analysis

Predictive modelling / ML engineering

Statistical reasoning

Attention to detail

Communication of data findings

LLM data workflows

Education

Bachelor/Master/PhD in data science / statistics / mathematics or related field

Tools

Python (Pandas, NumPy, scikit-learn)

R

SQL

Tableau/Power BI/Matplotlib/Seaborn

PyTorch / TensorFlow

Job description

prolificacademicltd seeks data science and analytics experts to take on paid assignments evaluating AI models. You review technical answers, check code and quantitative claims, and provide structured feedback on performance. A short skills assessment precedes invitations to participate.

The role is listed for Indianapolis, US. Responsibilities include judging accuracy of AI-generated analyses, validating statistical claims, running data scripts, and describing model strengths and weaknesses.