Remote Senior Data Scientist - AI Evaluation & Analysis

Synthires; Australia; Remote; AUD 338,000 - 386,000; Full time

Benefits offered by this job

Fully remote

Job summary

Synthires is seeking experienced Data Scientists and Quantitative Professionals to contribute to projects focused on improving AI systems' reasoning about data, statistics, ML, experimentation, and quantitative analysis. You will apply expertise to evaluate AI-produced results, develop challenging tasks, and provide feedback to enhance model performance.

The role emphasizes data science, analytics, statistics, and quantitative research with no prior AI experience required.

Qualifications

• Strong expertise in data science, statistics, machine learning, analytics, or a related quantitative field.
• Proficiency in Python and common data science libraries such as Pandas, NumPy, Scikit-learn, or similar tools.
• Strong understanding of statistical analysis, hypothesis testing, experimentation, and data modeling.

Responsibilities

• Evaluate AI-generated responses involving data science, machine learning, statistics, and quantitative reasoning.
• Create expert-level prompts, datasets, evaluation tasks, and reference solutions.
• Review statistical analyses, machine learning workflows, and experimental methodologies for accuracy and rigor.
• Identify flawed assumptions, methodological errors, statistical mistakes, and weaknesses in quantitative reasoning.
• Assess the quality, correctness, and completeness of analytical solutions.
• Provide structured feedback and detailed explanations to support model improvement.
• Develop realistic scenarios involving data analysis, predictive modeling, experimentation, and statistical inference.
• Document findings and recommendations clearly and accurately.

Skills

Data science

Statistics

Machine learning

Analytics

Python

Pandas

NumPy

Scikit-learn

Quantitative reasoning

Tools

Pandas

NumPy

Scikit-learn

Job description

Synthires is seeking experienced Data Scientists and Quantitative Professionals to contribute to projects focused on improving AI systems' reasoning about data, statistics, ML, experimentation, and quantitative analysis. You will apply expertise to evaluate AI-produced results, develop challenging tasks, and provide feedback to enhance model performance.

The role emphasizes data science, analytics, statistics, and quantitative research with no prior AI experience required.