Remote Data Scientist for AI Model Evaluation & Grading

SaidGig; New York (NY); Remote; USD 138,000 - 207,000; Part time

Job summary

SaidGig is seeking a data science evaluator to join a remote, hourly talent network supporting AI research evaluations. You'll design grading criteria, assess AI-generated and human work, and produce clear written explanations.

Ideal candidates have 1+ year of data science experience, strong Python and SQL, and demonstrated ability to turn real-world data into rigorous analyses. You will calibrate judgments to standard criteria and collaborate with senior reviewers.

Qualifications

• At least 1 year of professional data science experience.
• Experience at a leading technology, research, or quantitative firm.
• Strong Python and SQL, with statistics, ML, experimentation, and causal inference.

Responsibilities

• Create precise, task-specific grading criteria for data science deliverables.
• Evaluate AI-generated or human-created work using established criteria.
• Provide detailed written explanations supporting evaluations and scores.
• Apply consistent, evidence-based judgment to produce reproducible assessments.
• Incorporate structured feedback from senior reviewers and revise submitted work.

Skills

Python

SQL

Statistical modeling

Machine learning

Experimentation

Causal inference

Written communication

Attention to detail

Feedback to standards

Job description

SaidGig is seeking a data science evaluator to join a remote, hourly talent network supporting AI research evaluations. You'll design grading criteria, assess AI-generated and human work, and produce clear written explanations.

Ideal candidates have 1+ year of data science experience, strong Python and SQL, and demonstrated ability to turn real-world data into rigorous analyses. You will calibrate judgments to standard criteria and collaborate with senior reviewers.