Remote AI Training Assessment Writer

SaidGig; New York (NY); Remote; USD 124,000 - 193,000; Full time

Job summary

SaidGig is seeking a fully remote contract evaluator to assess AI-generated writing. You will score responses against rubric criteria, write detailed rationales, and flag fluent but unsupported or impractical content.

Prior AI experience is not required, but familiarity with assessment and technical writing is helpful. Work independently in a remote setting, collaborating asynchronously with project managers and reviewers to ensure high-quality evaluations and traceable decisions.

Qualifications

• First-language proficiency in written English.
• Completed degree from an accredited institution in the US, Canada, UK, Ireland, Australia, or NZ.
• Experience marking, grading, or examining written work against rubrics.
• Background in assessment design, instructional design, peer review, or academic writing support.
• Strong technical writing, editing, content-evaluation, and critical-analysis skills.
• Excellent attention to detail and ability to deliver objective judgments.
• Ability to work independently in a remote environment and meet deadlines.
• Experience with model evaluation, RLHF, or annotation is helpful but not required.

Responsibilities

• Evaluate and compare multiple AI-generated writings for clarity, tone, and adherence to instructions.
• Assign analytical quality scores using rubrics and guidelines.
• Write detailed rationales explaining each score or decision.
• Identify content that is fluent but unsupported or impractical for the audience.
• Detect factual errors and reliability issues affecting usability.
• Maintain thorough records of findings, decisions, and observations.
• Collaborate asynchronously with project managers and reviewers.

Skills

English fluency

Experience grading

Technical writing

Attention to detail

Independent remote work

Assessment design

Peer review

Model evaluation / RLHF (helpful)

Education

Completed degree (accredited) in US/UK/Canada/Ireland/Australia/New Zealand

Job description

SaidGig is seeking a fully remote contract evaluator to assess AI-generated writing. You will score responses against rubric criteria, write detailed rationales, and flag fluent but unsupported or impractical content.

Prior AI experience is not required, but familiarity with assessment and technical writing is helpful. Work independently in a remote setting, collaborating asynchronously with project managers and reviewers to ensure high-quality evaluations and traceable decisions.