Remote Educator & Assessor Writer - AI Evaluation

RemoteJobsOne; Columbus (OH); A distancia; USD 124.000 - 193.000; A tiempo parcial

Descripción de la vacante

RemoteJobsOne seeks Educator/ Assessor Writer for a fully remote role. You will evaluate AI-generated texts, score against rubrics, and provide detailed rationales. Ideal candidates have first-language English, a relevant degree, and experience with assessment design or academic writing support.

The position is contractor-based, remote-friendly across multiple countries, and emphasizes independent work and deadline discipline. Prior AI model evaluation exposure is a plus but not required.

Formación

• First-language proficiency or fully equivalent fluency in written English.
• Completed degree from an accredited institution in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.
• Experience marking, grading, or examining written work against set criteria or rubrics.
• Background in assessment design, instructional design, peer review, thesis supervision, or academic writing support.
• Keen attention to detail, critical analysis skills, and the ability to deliver objective, well-articulated judgments.
• Capable of independent remote work and meeting project deadlines.
• Experience with model evaluation, RLHF, or annotation is an asset but not mandatory.

Responsabilidades

• Evaluate and compare multiple AI-generated written responses for clarity, tone, helpfulness, and adherence to instructions.
• Assign analytical quality scores based on provided rubrics and guidelines.
• Compose detailed written rationales justifying each assessment or score.
• Identify responses that are fluent but unsupported, or comprehensive but not practical for their intended audience.
• Detect factual errors, internal inconsistencies, and issues affecting reliability or usability.
• Document findings meticulously and maintain thorough records of decisions and observations.
• Collaborate asynchronously with project managers and reviewers using digital content review platforms.

Conocimientos

Fluent written English

Assessment design

Remote work

Educación

US/Canada/UK/Australia/NZ degree

Descripción del empleo

RemoteJobsOne seeks Educator/ Assessor Writer for a fully remote role. You will evaluate AI-generated texts, score against rubrics, and provide detailed rationales. Ideal candidates have first-language English, a relevant degree, and experience with assessment design or academic writing support.

The position is contractor-based, remote-friendly across multiple countries, and emphasizes independent work and deadline discipline. Prior AI model evaluation exposure is a plus but not required.