Remote ML & Data Science Model Evaluator

IsoData; United States; Remote; USD 207,000 - 413,000; Full time

Job summary

IsoData is seeking contributors to create, grade, and review ML data-analysis tasks from home in the United States. You’ll write tasks with checkable answers and embedded pitfalls, grade responses, and review training or evaluation code for subtle bugs that affect results.

The role requires a quantitative degree, a hands-on ML project, and proficiency with Python and libraries like pandas, NumPy, scikit-learn, and PyTorch. Remote work is supported; apply as projects arise.

Qualifications

• You read and write Python with common data and ML libraries (pandas, NumPy, scikit-learn, PyTorch).
• One substantial ML or data project you did yourself, with results and checks.
• Ability to spot leaks, bad splits, and misleading metrics before trusting numbers.

Responsibilities

• Write data-analysis and modeling tasks with one checkable answer and a planted pitfall.
• Grade model answers on experiment design, metrics and statistical validity.
• Review training and evaluation code for bugs that quietly change results.
• Design rubrics for grading model outputs so graders reach the same score.
• Write reference notebooks showing the right analysis steps.
• Compare two model explanations and justify which is right and why.

Skills

Python

Data analysis

ML concepts

Education

Bachelors in CS/Stats

Masters or PhD preferred

Tools

pandas

NumPy

scikit-learn

PyTorch

Job description

IsoData is seeking contributors to create, grade, and review ML data-analysis tasks from home in the United States. You’ll write tasks with checkable answers and embedded pitfalls, grade responses, and review training or evaluation code for subtle bugs that affect results.

The role requires a quantitative degree, a hands-on ML project, and proficiency with Python and libraries like pandas, NumPy, scikit-learn, and PyTorch. Remote work is supported; apply as projects arise.