Assessment Writer for AI Training

SaidGig; New York (NY); Remote; USD 124,000 - 193,000; Full time

Job summary

SaidGig is seeking a fully remote contract evaluator to assess AI-generated writing. You will score responses against rubric criteria, write detailed rationales, and flag fluent but unsupported or impractical content.

Prior AI experience is not required, but familiarity with assessment and technical writing is helpful. Work independently in a remote setting, collaborating asynchronously with project managers and reviewers to ensure high-quality evaluations and traceable decisions.

Qualifications

• First-language proficiency in written English.
• Completed degree from an accredited institution in the US, Canada, UK, Ireland, Australia, or NZ.
• Experience marking, grading, or examining written work against rubrics.
• Background in assessment design, instructional design, peer review, or academic writing support.
• Strong technical writing, editing, content-evaluation, and critical-analysis skills.
• Excellent attention to detail and ability to deliver objective judgments.
• Ability to work independently in a remote environment and meet deadlines.
• Experience with model evaluation, RLHF, or annotation is helpful but not required.

Responsibilities

• Evaluate and compare multiple AI-generated writings for clarity, tone, and adherence to instructions.
• Assign analytical quality scores using rubrics and guidelines.
• Write detailed rationales explaining each score or decision.
• Identify content that is fluent but unsupported or impractical for the audience.
• Detect factual errors and reliability issues affecting usability.
• Maintain thorough records of findings, decisions, and observations.
• Collaborate asynchronously with project managers and reviewers.

Skills

English fluency

Experience grading

Technical writing

Attention to detail

Independent remote work

Assessment design

Peer review

Model evaluation / RLHF (helpful)

Education

Completed degree (accredited) in US/UK/Canada/Ireland/Australia/New Zealand

Job description

Role Overview

Help improve advanced AI systems by evaluating AI-generated writing and producing clear, evidence-based assessments. This fully remote contract role is well suited to professionals with experience grading, examining, or assessing written work against defined criteria. Prior AI experience is not required.

Key Responsibilities

• Evaluate and compare multiple AI-generated written responses for clarity, tone, helpfulness, and adherence to instructions.
• Assign analytical quality scores using provided rubrics and guidelines.
• Write detailed rationales that explain each score or assessment decision.
• Identify content that is fluent but unsupported, or comprehensive but impractical for its intended audience.
• Detect factual errors, internal inconsistencies, and issues that affect reliability or usability.
• Maintain thorough records of findings, decisions, and observations.
• Collaborate asynchronously with project managers and reviewers through digital content-review platforms.

Qualifications

• First-language proficiency, or fully equivalent fluency, in written English.
• Completed degree from an accredited institution in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.
• Experience marking, grading, or examining written work against established criteria or rubrics.
• Background in assessment design, instructional design, peer review, thesis supervision, or academic writing support.
• Strong technical writing, editing, content-evaluation, critical-analysis, and written-communication skills.
• Excellent attention to detail and the ability to deliver objective, well-articulated judgments.
• Ability to work independently in a remote environment and meet project deadlines.
• Experience with model evaluation, RLHF, or annotation is helpful but not required.

Work Terms

Remote contract engagement. Designed to offer flexibility alongside other professional obligations. Work involves independent contribution and virtual, asynchronous collaboration.

Compensation

$90 to $140 per hour.