Remote Data Scientist: AI Model Evaluation & QA

The Ai Training Company; United States; Remote; GBP 35,000 - 55,000; Full time

Job summary

The Ai Training Company is seeking Junior Data Scientists, Quantitative Analysts and ML researchers for a remote AI project in the United Kingdom. You will evaluate AI-generated solutions, identify methodological flaws, and develop challenging prompts and datasets to benchmark model performance.

Ideal candidates have strong statistical foundations, experience with real-world data, and the ability to communicate technical concepts clearly while working independently in a remote setup.

Qualifications

• At least 1 year of professional experience in data science or related field.
• Experience within the past 3 years.
• Strong foundation in statistics, probability, and quantitative reasoning.
• Experience analyzing real-world datasets and interpreting results.
• Ability to identify flawed methodology and statistical errors.
• Comfortable working remotely and independently.

Responsibilities

• Evaluate AI-generated responses across data science, statistics, machine learning, experimentation, and quantitative analysis.
• Identify incorrect assumptions, statistical errors, flawed methodology, weak experimental design, and unsupported conclusions.
• Create challenging expert-level prompts based on realistic analytical and quantitative problems.
• Build or review datasets used to evaluate model performance.
• Develop reference solutions that demonstrate correct methodology and reasoning.
• Assess whether analytical approaches are statistically sound, reproducible, and appropriate for the problem.
• Review model reasoning related to experimentation, causal inference, forecasting, predictive modeling, and data interpretation.
• Evaluate code and analytical workflows when relevant.
• Provide structured technical feedback explaining why an approach is correct or incorrect.
• Help refine evaluation criteria and improve the difficulty and quality of quantitative tasks.

Skills

Python

R

SQL

Statistics

Experimentation

Data analysis

Communication

Tools

Jupyter

Git

Job description

The Ai Training Company is seeking Junior Data Scientists, Quantitative Analysts and ML researchers for a remote AI project in the United Kingdom. You will evaluate AI-generated solutions, identify methodological flaws, and develop challenging prompts and datasets to benchmark model performance.

Ideal candidates have strong statistical foundations, experience with real-world data, and the ability to communicate technical concepts clearly while working independently in a remote setup.