Remote Writing Assessor & AI Evaluation Expert

Joblet-AI

United States

Remote

GBP 30,000 - 55,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Joblet-AI is seeking Educator/Assessor Writers to remotely contribute to a customer project focused on advanced AI system development. You will help train next-generation AI systems, shaping how models learn, reason, and perform with high-quality input.

No AI experience required; domain knowledge matters most. The role suits individuals experienced in evaluating written work against rubrics, academic writing review, or assessment design.

Qualifications

  • First-language proficiency or full fluency in written English.
  • Degree from an accredited institution in the US, Canada, UK, Ireland, Australia, or New Zealand.
  • Experience marking, grading, or examining written work against set criteria or rubrics.
  • Background in assessment design, instructional design, peer review, or academic writing support.
  • Keen attention to detail, critical analysis, and objective judgments.
  • Capable of independent remote work and meeting project deadlines.
  • Experience with model evaluation, RLHF, or annotation is a plus.

Responsibilities

  • Evaluate and compare multiple AI-generated written responses for clarity, tone, helpfulness, and adherence to instructions.
  • Assign analytical quality scores based on provided rubrics and guidelines.
  • Compose detailed written rationales justifying each assessment or score.
  • Identify responses that are fluent but unsupported, or comprehensive but not practical for their intended audience.
  • Detect factual errors, internal inconsistencies, and issues affecting reliability or usability.
  • Document findings meticulously and maintain thorough records of decisions and observations.
  • Collaborate asynchronously with project managers and reviewers using digital content review platforms.

Skills

First-language English
Excellent written English
Attention to detail
Critical analysis
Independent remote work

Education

Bachelor’s degree from an accredited US/Canada/UK/Ireland/Australia/New Zealand institution

Tools

Rubrics and assessment guidelines

Job description

Joblet-AI is seeking Educator/Assessor Writers to remotely contribute to a customer project focused on advanced AI system development. You will help train next-generation AI systems, shaping how models learn, reason, and perform with high-quality input.

No AI experience required; domain knowledge matters most. The role suits individuals experienced in evaluating written work against rubrics, academic writing review, or assessment design.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Educator & Assessor Writer for AI Training
Remote Educator & Assessor Writer for AI Training

Micro1 • United States

Remote
USD 48,000 - 80,000
Educator/ Assessor Writer
Educator/ Assessor Writer

Remotebridge • United States

Remote
USD 55,000 - 83,000
Educator/ Assessor Writer
Educator/ Assessor Writer

Micro1 • United States

Remote
USD 48,000 - 80,000
Writing Assessor (Remote)
Writing Assessor (Remote)

Joblet-AI • United States

Remote
GBP 30,000 - 55,000
Remote Educator & Assessor (AI Evaluation)
Remote Educator & Assessor (AI Evaluation)

Remotebridge • United States

Remote
USD 55,000 - 83,000
Remote AI Writing Evaluator & Journalist
Remote AI Writing Evaluator & Journalist

Micro1 • United States

Remote
USD 41,000 - 83,000
Remote AI Writing Evaluator & Journalist
Remote AI Writing Evaluator & Journalist

Remotebridge • United States

Remote
USD 55,000 - 83,000
Journalist/Writer
Journalist/Writer

Remotebridge • United States

Remote
USD 55,000 - 83,000
Journalist/Writer
Journalist/Writer

Micro1 • United States

Remote
USD 41,000 - 83,000
Remote English Educator & AI Writing Evaluator
Remote English Educator & AI Writing Evaluator

Aitrainergigs • United States

Remote
USD 34,000 - 69,000