Freelance AI Project Reviewer

Masterclass; Northern (KY); Hybrid; USD 103,000 - 172,000; Part time

Job summary

MasterClass is seeking a freelance AI Project Reviewer to evaluate learner submissions against rubrics, providing pass/fail judgments and clear feedback. You will collaborate with product and learning design teams to calibrate assessment approaches and ensure fair feedback for members.

This temporary role offers ~20 hours per week, with a flexible engagement based on project needs. Experience in educational evaluation and strong written communication are essential.

Qualifications

• 5+ years of experience in assessment, evaluation, or educational feedback roles.
• Proven ability to apply detailed rubrics across multiple submissions.
• Strong written communication skills with the ability to articulate reasoning clearly.
• Experience giving constructive feedback to support learner growth.

Responsibilities

• Review projects against detailed rubrics and provide consistent pass/fail judgments.
• Write clear, actionable feedback to help learners improve.
• Collaborate with learning design and product teams to refine rubrics and criteria.
• Compare human and AI assessment outcomes to identify calibration needs.
• Document reasoning behind evaluation decisions to support consistency.

Skills

Assessment expertise

Educational feedback

Written communication

Independent worker

Attention to detail

Job description

MasterClass is seeking a freelance AI Project Reviewer to evaluate learner submissions against rubrics, providing pass/fail judgments and clear feedback. You will collaborate with product and learning design teams to calibrate assessment approaches and ensure fair feedback for members.

This temporary role offers ~20 hours per week, with a flexible engagement based on project needs. Experience in educational evaluation and strong written communication are essential.