AI Model Auditor & Data Scientist (Remote)

prolificacademicltd; United States; Remote; USD 34,000 - 83,000; Full time

Benefits offered by this job

Flexible, remote participation

Job summary

Prolific Academic Ltd. is seeking contributors to join a data science and analytics program that trains and evaluates AI models through paid, individual tasks. You will check model-generated statistical reasoning, data interpretations, and code for accuracy and usefulness. Some tasks require an uninterrupted hour.

Applicants complete a short skills assessment before invitation. Tasks vary in length and can be performed remotely, offering flexible participation and paid work on a per-task basis.

Qualifications

• Degree in data science, statistics, mathematics, or related quantitative field.
• Strong statistical problem-solving and data interpretation skills.
• Ability to spot subtle errors in statistical arguments and data interpretations.
• Experience using large language models in data workflows.

Responsibilities

• Assess AI-generated analyses for statistical accuracy, clarity, and completeness.
• Verify formulas, proofs, and data-based conclusions against reliable references.
• Run data scripts to check results, correctness, and handling of edge cases.
• Identify strengths and weaknesses in model reasoning about statistics and predictive modeling.
• Check that responses follow task guidelines and appropriate technical standards.

Skills

Statistical problem-solving

Interpret complex visualizations

Clear written communication

Experience with LLMs in data workflows

Education

Bachelor’s/Master’s/Doctoral in data science or related quantitative field

Tools

Python

R

SQL

Data visualization tools

Job description

Prolific Academic Ltd. is seeking contributors to join a data science and analytics program that trains and evaluates AI models through paid, individual tasks. You will check model-generated statistical reasoning, data interpretations, and code for accuracy and usefulness. Some tasks require an uninterrupted hour.

Applicants complete a short skills assessment before invitation. Tasks vary in length and can be performed remotely, offering flexible participation and paid work on a per-task basis.