AI Data Analyst for Model Evaluation (Remote)

Prolific; Sheffield; A distancia; GBP 26.000 - 82.000; A tiempo parcial

Ventajas ofrecidas por este puesto de trabajo

Flexible hours

Work from home

Descripción de la vacante

Prolific is seeking Data Scientists and Data Analysts to join its Expert Network. You’ll train and evaluate AI models using real technical expertise, with paid tests and the possibility to join Prolific as a paid participant.

Tasks may require one hour of focused work, with many shorter opportunities, and compensation up to $80 per hour. You'll assess AI outputs, validate data workflows, and annotate model performance.

Formación

• BS/MS/PhD in Data Science, Statistics, Mathematics, or closely related quantitative field.
• Real-world experience in data analysis, predictive modeling, or ML engineering.
• Ability to solve complex statistical problems and interpret high-level data visualizations.
• Strong attention to detail with ability to identify subtle logical fallacies in statistical reasoning.
• Significant experience using LLMs to assist with data workflows; understand model limitations.
• Ability to explain complex mathematical concepts or data insights clearly.

Responsabilidades

• Evaluate AI-generated data insights and statistical analyses for accuracy and clarity.
• Fact-check technical claims using authoritative references.
• Validate code outputs by running data-related scripts (Python/R).
• Annotate model performance, identifying strengths and weaknesses in data reasoning.
• Ensure model responses align with system guidelines and maintain professional standards.

Conocimientos

Data analysis

Predictive modeling

Statistical reasoning

Communication

LLM usage

Attention to detail

Educación

BS/MS/PhD in Data Science or related field

Herramientas

Python

R

SQL

Tableau

PowerBI

Matplotlib/Seaborn

PyTorch/TensorFlow

Descripción del empleo

Prolific is seeking Data Scientists and Data Analysts to join its Expert Network. You’ll train and evaluate AI models using real technical expertise, with paid tests and the possibility to join Prolific as a paid participant.

Tasks may require one hour of focused work, with many shorter opportunities, and compensation up to $80 per hour. You'll assess AI outputs, validate data workflows, and annotate model performance.