Educator/ Assessor Writer - Remote

YO AI Labs; New York (NY); Remote; USD 34,000 - 76,000; Part time

Job summary

YO AI Labs is seeking an Educator/Assessor Writer to review and evaluate AI-generated content. You will apply expertise in education, assessment, academic writing, grading, and rubric-based evaluation to review written responses for clarity, accuracy, and usefulness.

The role is fully remote and contract-based, offering flexibility to balance other commitments while contributing to an important evaluation project. No prior AI experience required.

Qualifications

• Native or near-native written fluency in English.
• Degree from an accredited institution in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.
• Experience grading, marking, or evaluating written work against established criteria or rubrics.
• Background in assessment design, instructional design, academic writing, peer review, or thesis supervision.
• Strong critical-analysis and written communication skills.
• Excellent attention to detail and ability to make objective assessments.
• Ability to work independently and meet project deadlines.

Responsibilities

• Evaluate and compare AI-generated responses for clarity, accuracy, tone, helpfulness, and adherence to instructions.
• Assess responses using provided rubrics, guidelines, and evaluation criteria.
• Assign quality scores and provide clear, well-reasoned rationales.
• Identify unsupported claims, inaccuracies, inconsistencies, and content gaps.
• Evaluate whether responses are appropriate and practical for their intended audience.
• Document evaluation decisions and observations accurately.
• Collaborate asynchronously with project managers and reviewers using digital content review platforms.
• Maintain consistency and objectivity across assigned evaluations.

Skills

English fluency

Critical analysis

Written communication

Independent work

Deadline orientation

Education

Bachelor’s degree (US/Canada/UK/Ireland/Australia/New Zealand)

Job description

Educator/Assessor Writer

Role Type: Contractor
Location: Remote

Job Summary

We are looking for Educator/Assessor Writers to support an AI evaluation project focused on assessing and improving AI-generated content. You will apply your expertise in education, assessment, academic writing, grading, and rubric-based evaluation to review written responses.

No prior AI experience is required.

This role is ideal for professionals experienced in evaluating written work, developing assessments, grading against rubrics, or supporting academic writing. The engagement is fully remote and can be completed alongside other professional commitments.

Key Responsibilities

• Evaluate and compare AI-generated responses for clarity, accuracy, tone, helpfulness, and adherence to instructions.
• Assess responses using provided rubrics, guidelines, and evaluation criteria.
• Assign quality scores and provide clear, well-reasoned rationales.
• Identify unsupported claims, inaccuracies, inconsistencies, and content gaps.
• Evaluate whether responses are appropriate and practical for their intended audience.
• Document evaluation decisions and observations accurately.
• Collaborate asynchronously with project managers and reviewers using digital content review platforms.
• Maintain consistency and objectivity across assigned evaluations.

Required Qualifications

• Native or near-native written fluency in English.
• Degree from an accredited institution in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.
• Experience grading, marking, or evaluating written work against established criteria or rubrics.
• Background in assessment design, instructional design, academic writing, peer review, or thesis supervision.
• Strong critical-analysis and written communication skills.
• Excellent attention to detail and ability to make objective assessments.
• Ability to work independently and meet project deadlines.

Preferred Skills

• Experience with AI model evaluation or data annotation.
• Familiarity with RLHF or AI training workflows.
• Experience using digital assessment or content review platforms.
• Strong understanding of educational assessment and rubric design.