Remote Educator & Assessor Writer for Rubric-Based Evaluation

24-MAG; United States; Remote; USD 124,000 - 193,000; Full time

Job summary

24-MAG LLC offers a fully remote, contractor-based opportunity for experienced educators and evaluators to assess AI-generated written responses using structured rubrics. You will deliver concise, well-justified evaluations and rationales while maintaining high accuracy and consistency across tasks.

The role emphasizes independent work, strong editing skills, and meticulous attention to detail, with flexible scheduling and remote collaboration to fit other commitments.

Qualifications

• First-language proficiency in written English.
• Experience marking, grading, examining, or reviewing written work against defined criteria.
• Background in assessment design, instructional design, peer review, or academic writing support.
• Strong critical-analysis and content-evaluation skills.
• Excellent written communication and editing ability.
• Ability to work independently in a remote environment.
• Familiarity with digital content-review platforms is advantageous.
• Experience with model evaluation, RLHF, annotation, or similar workflows is beneficial but not required.

Responsibilities

• Evaluate AI-generated written responses and apply structured assessment criteria.
• Identify factual and reasoning issues and produce clear written rationales.
• Apply rubrics and evaluation guidelines to scoring and rankings.
• Detect factual errors, unsupported claims, and inconsistencies.
• Produce detailed written rationales explaining assessment decisions.
• Collaborate asynchronously with project managers and reviewers.

Skills

English fluency

Assessment design

Written evaluation

Attention to detail

Remote collaboration

Education

Bachelor's degree or higher

Tools

Content-review platforms

Job description

24-MAG LLC offers a fully remote, contractor-based opportunity for experienced educators and evaluators to assess AI-generated written responses using structured rubrics. You will deliver concise, well-justified evaluations and rationales while maintaining high accuracy and consistency across tasks.

The role emphasizes independent work, strong editing skills, and meticulous attention to detail, with flexible scheduling and remote collaboration to fit other commitments.