Senior AI Evaluation Scientist (Contract) - Remote

YO AI Labs; Houston (TX); Remote; USD 83,000 - 152,000; Part time

Job summary

YO AI Labs is seeking a Data Scientist contractor to evaluate AI outputs, design prompts and datasets, and provide actionable feedback to improve model performance. This role emphasizes rigorous data analysis, experimentation, and clear communication of results, with remote work options.

The ideal candidate has hands-on experience in ML, statistics, and data modeling, and can explain complex concepts clearly.

Qualifications

• Proficiency in Python for data science and Pandas for data manipulation.
• Experience applying ML algorithms to real datasets.
• Strong understanding of statistical methods and experimental design.
• Ability to analyze data and extract actionable insights.
• Familiarity with designing and evaluating experiments.

Responsibilities

• Evaluate AI outputs across data science, statistics, ML, and quantitative problems.
• Create expert-level prompts, datasets, and reference solutions.
• Identify statistical errors, flawed methodologies, and weak reasoning.
• Provide structured feedback to improve AI model capabilities.

Skills

Python & Pandas

Machine Learning

Statistics

Data Analysis

Experimentation

Data Modeling

Education

Undergraduate degree

Job description

YO AI Labs is seeking a Data Scientist contractor to evaluate AI outputs, design prompts and datasets, and provide actionable feedback to improve model performance. This role emphasizes rigorous data analysis, experimentation, and clear communication of results, with remote work options.

The ideal candidate has hands-on experience in ML, statistics, and data modeling, and can explain complex concepts clearly.