Remote Data Scientist: AI Evaluation & Quant Analytics

The Ai Training Company; New Zealand; Remote; NZD 60,000 - 90,000; Full time

Job summary

The Ai Training Company in New Zealand is seeking junior and mid-level data professionals to contribute to a remote AI project focused on statistics, machine learning, experimentation, and quantitative reasoning.

You will evaluate AI-generated solutions, identify flawed methods, develop reference solutions, and provide structured feedback to improve model performance. This role suits quantitatively strong candidates who work well remotely and communicate technical results clearly.

Qualifications

• At least one year of professional experience in data science or a closely related field.
• Experience analyzing real-world datasets and interpreting results.
• Ability to identify flawed methodology and statistical errors.
• Strong understanding of experimentation or model evaluation principles.
• Working knowledge of Python, R, SQL or comparable tools.
• Excellent written communication of technical concepts.

Responsibilities

• Evaluate AI-generated responses across data science, statistics, ML, experimentation, and quantitative analysis.
• Identify incorrect assumptions, statistical errors, flawed methodology, and weak experimental design.
• Create challenging expert-level prompts based on analytical problems.
• Build or review datasets used to evaluate model performance.
• Develop reference solutions that demonstrate correct methodology and reasoning.
• Assess whether analytical approaches are statistically sound and reproducible.
• Review model reasoning related to experimentation, causal inference, forecasting, and data interpretation.
• Evaluate code and analytical workflows when relevant.
• Provide structured technical feedback explaining why an approach is correct or incorrect.
• Help refine evaluation criteria and improve the quality of quantitative tasks.

Skills

Statistics

Probability

Quantitative reasoning

Python

R

SQL

Data analysis

Problem solving

Written communication

Tools

Python

R

SQL

Job description

The Ai Training Company in New Zealand is seeking junior and mid-level data professionals to contribute to a remote AI project focused on statistics, machine learning, experimentation, and quantitative reasoning.

You will evaluate AI-generated solutions, identify flawed methods, develop reference solutions, and provide structured feedback to improve model performance. This role suits quantitatively strong candidates who work well remotely and communicate technical results clearly.