AI Language Reviewer & Rubric Calibration (Remote)

AuraOne Human Data

United States

A distancia

USD 28.000 - 55.000

Jornada completa

14 días+

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Descripción de la vacante

AuraOne, Inc. is seeking an English Language Expert for Australia & New Zealand to remotely review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and write structured feedback to help retrain models.

The role requires clear written reasoning, attention to detail, and the ability to flag issues in long rubric-driven batches. Remote, contractor position with flexible weekly hours.

Formación

  • Prior evaluation, annotation, or human-rater experience on English Language Expert (Australia & New Zealand) — AI Review (Remote) work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Responsabilidades

  • Evaluate english language evaluation model outputs against a versioned rubric and assign severity tags for English Language Expert (Australia & New Zealand) — AI Review (Remote) assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Conocimientos

English language evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
Remote work readiness

Descripción del empleo

AuraOne, Inc. is seeking an English Language Expert for Australia & New Zealand to remotely review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and write structured feedback to help retrain models.

The role requires clear written reasoning, attention to detail, and the ability to flag issues in long rubric-driven batches. Remote, contractor position with flexible weekly hours.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Remote AU English Evaluator & Rubric Reviewer
Remote AU English Evaluator & Rubric Reviewer

AuraOne Human Data • EE. UU.

A distancia
USD 45.000 - 65.000
Remote contractor
US-eligible
Contractor role
+1
Remote English Language Evaluator for AI Rubric QA & Feedback
Remote English Language Evaluator for AI Rubric QA & Feedback

AuraOne Human Data • EE. UU.

A distancia
USD 28.000 - 41.000
AI English Language Evaluator — Remote Review Specialist
AI English Language Evaluator — Remote Review Specialist

AuraOne Human Data • EE. UU.

A distancia
USD 34.000 - 69.000
AI Evaluation Linguistic Expert - Remote (NZ English)
AI Evaluation Linguistic Expert - Remote (NZ English)

AuraOne Human Data • EE. UU.

A distancia
USD 45.000 - 65.000
English Language Expert (Australia & New Zealand) — AI Review (Remote)
English Language Expert (Australia & New Zealand) — AI Review (Remote)

AuraOne Human Data • EE. UU.

A distancia
USD 28.000 - 55.000
Remote AI Evaluation & Annotation Specialist
Remote AI Evaluation & Annotation Specialist

Auraone • EE. UU.

A distancia
USD 28.000 - 55.000
Remote English Audio Evaluation Specialist
Remote English Audio Evaluation Specialist

Auraone • EE. UU.

A distancia
USD 58.000 - 80.000
Remote Conlang Evaluation Specialist & Feedback Analyst
Remote Conlang Evaluation Specialist & Feedback Analyst

Auraone • EE. UU.

A distancia
USD 28.000 - 48.000
Remote work
Remote AI Image Quality Reviewer & Rubric Specialist
Remote AI Image Quality Reviewer & Rubric Specialist

AuraOne Human Data • EE. UU.

A distancia
USD 28.000 - 48.000
Remote English Generalist Evaluator & Rubric Auditor
Remote English Generalist Evaluator & Rubric Auditor

AuraOne Human Data • EE. UU.

A distancia
USD 28.000 - 138.000