Remote Data Scientist - AI Evaluation & Modeling

The Ai Training Company; Australia; Remote; AUD 70,000 - 110,000; Full time

Job summary

The Ai Training Company is hiring for Junior Data Scientists, Quantitative Analysts and ML researchers to contribute to a remote AI project focused on statistics, machine learning, experimentation, and quantitative reasoning. You will evaluate AI-generated solutions and identify flawed methodology.

The role emphasizes building reference solutions, datasets, and structured feedback to improve model performance, with a strong emphasis on independent work in a distributed environment.

Qualifications

• At least one year of professional experience in data science, quantitative analysis, statistics, machine learning, finance, research, or a closely related field.
• At least part of that experience must have occurred within the past three years.
• Strong foundation in statistics, probability, and quantitative reasoning.
• Experience analyzing real-world datasets and interpreting results.
• Ability to identify flawed methodology and statistical errors.
• Strong understanding of experimentation or model evaluation principles.
• Working knowledge of Python, R, SQL, or comparable quantitative tools.
• Strong analytical and problem-solving skills.
• Ability to communicate technical and statistical concepts clearly in writing.
• Comfortable working independently in a remote environment.

Responsibilities

• Evaluate AI-generated responses across data science, statistics, machine learning, experimentation, and quantitative analysis.
• Identify incorrect assumptions, statistical errors, flawed methodology, weak experimental design, and unsupported conclusions.
• Create challenging expert-level prompts based on realistic analytical and quantitative problems.
• Build or review datasets used to evaluate model performance.
• Develop reference solutions that demonstrate correct methodology and reasoning.
• Assess whether analytical approaches are statistically sound, reproducible, and appropriate for the problem.
• Review model reasoning related to experimentation, causal inference, forecasting, predictive modeling, and data interpretation.
• Evaluate code and analytical workflows when relevant.
• Provide structured technical feedback explaining why an approach is correct or incorrect.
• Help refine evaluation criteria and improve the difficulty and quality of quantitative tasks.

Skills

Statistics

Probability

Data analysis

Python

R

SQL

Tools

Python

R

SQL

Job description

The Ai Training Company is hiring for Junior Data Scientists, Quantitative Analysts and ML researchers to contribute to a remote AI project focused on statistics, machine learning, experimentation, and quantitative reasoning. You will evaluate AI-generated solutions and identify flawed methodology.

The role emphasizes building reference solutions, datasets, and structured feedback to improve model performance, with a strong emphasis on independent work in a distributed environment.