Writing Assessor (Remote)

Joblet-AI

United States

À distance

GBP 30 000 - 55 000

Plein temps

Il y a 2 jours
Soyez parmi les premiers à postuler

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Résumé du poste

Joblet-AI is seeking Educator/Assessor Writers to remotely contribute to a customer project focused on advanced AI system development. You will help train next-generation AI systems, shaping how models learn, reason, and perform with high-quality input.

No AI experience required; domain knowledge matters most. The role suits individuals experienced in evaluating written work against rubrics, academic writing review, or assessment design.

Qualifications

  • First-language proficiency or full fluency in written English.
  • Degree from an accredited institution in the US, Canada, UK, Ireland, Australia, or New Zealand.
  • Experience marking, grading, or examining written work against set criteria or rubrics.
  • Background in assessment design, instructional design, peer review, or academic writing support.
  • Keen attention to detail, critical analysis, and objective judgments.
  • Capable of independent remote work and meeting project deadlines.
  • Experience with model evaluation, RLHF, or annotation is a plus.

Responsabilités

  • Evaluate and compare multiple AI-generated written responses for clarity, tone, helpfulness, and adherence to instructions.
  • Assign analytical quality scores based on provided rubrics and guidelines.
  • Compose detailed written rationales justifying each assessment or score.
  • Identify responses that are fluent but unsupported, or comprehensive but not practical for their intended audience.
  • Detect factual errors, internal inconsistencies, and issues affecting reliability or usability.
  • Document findings meticulously and maintain thorough records of decisions and observations.
  • Collaborate asynchronously with project managers and reviewers using digital content review platforms.

Connaissances

First-language English
Excellent written English
Attention to detail
Critical analysis
Independent remote work

Formation

Bachelor’s degree from an accredited US/Canada/UK/Ireland/Australia/New Zealand institution

Outils

Rubrics and assessment guidelines

Description du poste

Educator/ Assessor Writers to contribute expertise on a customer project focused on advanced AI system development.

In this role, you'll apply your expertise to help train next-generation AI systems.

Your work will shape how models learn, reason, and perform through high-quality, real-world input.

No prior experience in AI is required — your domain knowledge is what matters.

This opportunity is ideal for individuals experienced in evaluating written work against a rubric, examining academic writing, or designing effective assessments.

The engagement is fully remote and offers the flexibility to participate alongside other professional obligations.

Scope of Work
  1. Evaluate and compare multiple AI-generated written responses for clarity, tone, helpfulness, and adherence to instructions.
  2. Assign analytical quality scores based on provided rubrics and guidelines.
  3. Compose detailed written rationales justifying each assessment or score.
  4. Identify responses that are fluent but unsupported, or comprehensive but not practical for their intended audience.
  5. Detect factual errors, internal inconsistencies, and issues affecting reliability or usability.
  6. Document findings meticulously and maintain thorough records of decisions and observations.
  7. Collaborate asynchronously with project managers and reviewers using digital content review platforms.
Preferred Qualifications
  1. First-language proficiency or fully equivalent fluency in written English.
  2. Completed degree from an accredited institution in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.
  3. Experience marking, grading, or examining written work against set criteria or rubrics.
  4. Background in assessment design, instructional design, peer review, thesis supervision, or academic writing support.
  5. Keen attention to detail, critical analysis skills, and the ability to deliver objective, well-articulated judgments.
  6. Capable of independent remote work and meeting project deadlines.
  7. Experience with model evaluation, RLHF, or annotation is an asset but not mandatory.
What You’ll Do
  1. Evaluate and compare multiple AI-generated written responses for clarity, tone, helpfulness, and adherence to instructions.
  2. Assign analytical quality scores based on provided rubrics and guidelines.
  3. Compose detailed written rationales justifying each assessment or score.
  4. Identify responses that are fluent but unsupported, or comprehensive but not practical for their intended audience.
  5. Detect factual errors, internal inconsistencies, and issues affecting reliability or usability.
  6. Document findings meticulously and maintain thorough records of decisions and observations.
Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Educator/ Assessor Writer
Educator/ Assessor Writer

Remotebridge • États-Unis

À distance
USD 55 000 - 83 000
Educator/ Assessor Writer
Educator/ Assessor Writer

Micro1 • États-Unis

À distance
USD 48 000 - 80 000
Journalist/Writer
Journalist/Writer

Remotebridge • États-Unis

À distance
USD 55 000 - 83 000
Remote Writing Assessor & AI Evaluation Expert
Remote Writing Assessor & AI Evaluation Expert

Joblet-AI • États-Unis

À distance
GBP 30 000 - 55 000
Journalist/Writer
Journalist/Writer

Micro1 • États-Unis

À distance
USD 41 000 - 83 000
Content Writer at YO AI Labs
Content Writer at YO AI Labs

Feedinkoo: Remote Jobs • États-Unis

À distance
USD 42 000 - 65 000
Remote Educator & Assessor Writer for AI Training
Remote Educator & Assessor Writer for AI Training

Micro1 • États-Unis

À distance
USD 48 000 - 80 000
Generalist Expert (Remote | $50–$70/hr)
Generalist Expert (Remote | $50–$70/hr)

Synthires • Austin (TX)

À distance
USD 55 000 - 69 000
AI Evaluation Rubric Writer
AI Evaluation Rubric Writer

AuraOne, Inc. • États-Unis

À distance
USD 34 000 - 55 000
Remote Educator & Assessor (AI Evaluation)
Remote Educator & Assessor (AI Evaluation)

Remotebridge • États-Unis

À distance
USD 55 000 - 83 000