AI Model Evaluation Scientist – Data, ML & Prompts

Synthires; United States; Remote; AUD 486,000 - 555,000; Full time

Job summary

micro1 is seeking data scientists and quantitative professionals to improve AI models through statistics, machine learning, experimentation, and quantitative reasoning. You will evaluate AI-generated outputs and craft expert prompts, datasets, and reference solutions.

Ideal candidates have strong Python skills, ML knowledge, and experience with experimentation and data modeling. You will identify methodological errors and provide actionable feedback to enhance model reliability and performance.

Qualifications

• Strong knowledge of Python, machine learning, statistics, and data analysis.
• Experience with experimentation, Pandas, and data modeling.
• Ability to evaluate quantitative problems and identify methodological or statistical errors.
• Strong analytical and problem-solving skills.

Responsibilities

• Evaluate AI-generated outputs involving data science, statistics, machine learning, and quantitative problems.
• Create expert-level prompts, datasets, and reference solutions.
• Identify flawed methodologies, statistical errors, and weaknesses in quantitative reasoning.
• Provide structured feedback to improve AI model performance and reliability.

Skills

Python

Machine learning

Statistics

Data analysis

Tools

Pandas

Job description

micro1 is seeking data scientists and quantitative professionals to improve AI models through statistics, machine learning, experimentation, and quantitative reasoning. You will evaluate AI-generated outputs and craft expert prompts, datasets, and reference solutions.

Ideal candidates have strong Python skills, ML knowledge, and experience with experimentation and data modeling. You will identify methodological errors and provide actionable feedback to enhance model reliability and performance.