AI Data Scientist / Analyst — Train & Validate Models (Remote)

Prolific Academic Ltd; United States; Remote; USD 66,000 - 110,000; Full time

Job summary

Prolific is recruiting Data Scientists and Data Analysts to join our Expert Network, helping to train and evaluate cutting-edge AI models using real technical expertise. A quick test assesses suitability, and successful candidates may join Prolific as participants with pay up to $80/hour and one-hour uninterrupted work blocks.

Roles emphasize evaluating LLM outputs, validating statistical claims, and documenting model performance.

Qualifications

• BS, MS, or PhD in Data Science, Statistics, Mathematics, or a closely related quantitative field.
• Real-world experience in data analysis, predictive modeling, or machine learning engineering.
• Ability to solve complex statistical problems and interpret high-level data visualizations independently.
• Strong attention to detail with the ability to identify subtle logical fallacies in statistical reasoning or data interpretations.
• Significant experience using LLMs to assist with data workflows, with a clear understanding of where these models typically hallucinate or fail.
• Ability to explain complex mathematical concepts or data insights clearly and concisely.
• A PayPal account to receive payment from our clients.

Responsibilities

• Evaluate LLM responses for accuracy, clarity, and completeness.
• Fact-check technical claims using authoritative references to validate mathematical proofs, statistical formulas, and data-driven conclusions.
• Validate code & outputs by executing data-related scripts (e.g., Python/R) to ensure they produce correct results and handle edge cases properly.
• Annotate model performance by identifying strengths and weaknesses in how a model reasons through data problems or builds predictive models.
• Ensure alignment by verifying that model responses follow system guidelines and maintain a high standard of professional technical behavior.

Job description

Prolific is recruiting Data Scientists and Data Analysts to join our Expert Network, helping to train and evaluate cutting-edge AI models using real technical expertise. A quick test assesses suitability, and successful candidates may join Prolific as participants with pay up to $80/hour and one-hour uninterrupted work blocks.

Roles emphasize evaluating LLM outputs, validating statistical claims, and documenting model performance.