Remote Data Science QA Lead – Contractor

OpenTrain AI; Northern (KY); Hybrid; USD 91,000 - 152,000; Part time

Benefits offered by this job

Remote hourly contractor role

Job summary

OpenTrain AI is seeking a Data Science QA Lead to review AI-generated data science content and trainer QA work. You will assess statistical accuracy, model selection, code correctness, reproducibility, metric interpretation, business context, instruction following, and rubric adherence.

This remote hourly contractor role is for US-based contributors working 20+ hours per week. The advertised rate is up to $110 per hour, with a focus on precise written feedback and improving QA processes.

Qualifications

• Degree in data science, statistics, computer science, machine learning, or related quantitative field.
• Strong English communication for clear technical feedback and team coordination.
• At least 3 years of experience in data science, analytics, ML, or related fields.
• Strong understanding of statistics, model evaluation, experimentation, and validation methods.
• Familiarity with Python, pandas, NumPy, scikit-learn, SQL, Jupyter, and related tools.
• Experience with AI training, data annotation, LLM evaluation, or rubric-based review is a plus.

Responsibilities

• Review AI-generated data science explanations, Python, R, and SQL snippets, modeling workflows, dashboards, and experiments.
• Check for data leakage, flawed assumptions, incorrect metrics, weak methodology, non-reproducible code, and misleading conclusions.
• Assess analytical work against rubrics covering statistical accuracy, model selection, code correctness, business context, and instruction following.
• Communicate guideline changes and workflow updates to trainers and QAs.
• Create and maintain style guides, trackers, FAQs, examples, calibration tasks, and onboarding materials.
• Support onboarding and training calls for contributors.
• Identify recurring issues and help improve QA processes.

Skills

Data science

Statistics

Machine learning

English communication

Rubric-based review

Education

Degree in data science or related quantitative field

Tools

Python

SQL

R

Pandas

NumPy

scikit-learn

Jupyter

Matplotlib

Spark

Git

MLflow

Job description

OpenTrain AI is seeking a Data Science QA Lead to review AI-generated data science content and trainer QA work. You will assess statistical accuracy, model selection, code correctness, reproducibility, metric interpretation, business context, instruction following, and rubric adherence.

This remote hourly contractor role is for US-based contributors working 20+ hours per week. The advertised rate is up to $110 per hour, with a focus on precise written feedback and improving QA processes.