Remote AI Content Evaluator & Rubric Specialist

24-Mag Llc; Northern, New York (KY, NY); Hybrid; USD 124,000 - 193,000; Full time

Job summary

24-MAG LLC seeks experienced Educator/ Assessor Writers for remote evaluation of AI-generated written responses. You will apply structured rubrics, assess clarity and relevance, and provide detailed rationales to ensure consistent quality judgments across tasks.

Ideal candidates have a strong background in assessment, instructional design, and academic writing, with exceptional attention to detail and the ability to work independently in a remote setting.

Qualifications

• First-language proficiency in written English or equivalent.
• Experience marking, grading, examining, or reviewing written work against defined criteria.
• Background in assessment design, instructional design, peer review, thesis supervision, or academic writing support.

Responsibilities

• Evaluate AI-generated written responses for clarity, tone, usefulness, relevance, and instruction adherence.
• Apply rubric-based assessment and scoring to determine analytical quality scores.
• Identify factual errors, inconsistencies, and areas needing stronger support or justification.

Skills

English fluency

Instructional design

Academic writing

Critical analysis

Attention to detail

Remote collaboration

Education

US/CA/UK/AU degree

Tools

Digital content-review platforms

Job description

24-MAG LLC seeks experienced Educator/ Assessor Writers for remote evaluation of AI-generated written responses. You will apply structured rubrics, assess clarity and relevance, and provide detailed rationales to ensure consistent quality judgments across tasks.

Ideal candidates have a strong background in assessment, instructional design, and academic writing, with exceptional attention to detail and the ability to work independently in a remote setting.