AI Evaluation Linguistic Expert - Remote (NZ English)

AuraOne Human Data

United States

Remote

USD 45.000 - 65.000

Vollzeit

14 Tage+

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

AuraOne, Inc. is seeking an English (New Zealand) Linguistic Expert — AI Evaluation (Remote) to review model outputs and provide structured feedback.

This independent contractor role emphasizes applying rubrics across large batches with careful reasoning and calibration against gold-standard examples. Responsibilities include evaluating outputs, tagging edge cases, and documenting recurring failure modes to guide future rubric updates.

Qualifikationen

  • Prior evaluation, annotation, or human-rater experience on English linguistic evaluation for English (New Zealand) Linguistic Expert — AI Evaluation (Remote) work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Aufgaben

  • Evaluate English linguistic evaluation model outputs against a versioned rubric and assign severity tags for Remote assignments.
  • Compare paired responses and select the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples.

Kenntnisse

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
English Linguistic evaluation

Jobbeschreibung

AuraOne, Inc. is seeking an English (New Zealand) Linguistic Expert — AI Evaluation (Remote) to review model outputs and provide structured feedback.

This independent contractor role emphasizes applying rubrics across large batches with careful reasoning and calibration against gold-standard examples. Responsibilities include evaluating outputs, tagging edge cases, and documenting recurring failure modes to guide future rubric updates.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

English (New Zealand) Linguistic Expert — AI Evaluation (Remote)
English (New Zealand) Linguistic Expert — AI Evaluation (Remote)

AuraOne Human Data • USA

Remote
USD 45.000 - 65.000
AI Language Reviewer & Rubric Calibration (Remote)
AI Language Reviewer & Rubric Calibration (Remote)

AuraOne Human Data • USA

Remote
USD 28.000 - 55.000
Remote AU English Evaluator & Rubric Reviewer
Remote AU English Evaluator & Rubric Reviewer

AuraOne Human Data • USA

Remote
USD 45.000 - 65.000
Remote contractor
US-eligible
Contractor role
+1
Remote English Language Evaluator for AI Rubric QA & Feedback
Remote English Language Evaluator for AI Rubric QA & Feedback

AuraOne Human Data • USA

Remote
USD 28.000 - 41.000
Remote NZ English Linguistic Expert for AI Research
Remote NZ English Linguistic Expert for AI Research

Confidential • USA

Remote
USD 34.000 - 69.000
English Language Expert (Australia & New Zealand) — AI Review (Remote)
English Language Expert (Australia & New Zealand) — AI Review (Remote)

AuraOne Human Data • USA

Remote
USD 28.000 - 55.000
AI English Language Evaluator — Remote Review Specialist
AI English Language Evaluator — Remote Review Specialist

AuraOne Human Data • USA

Remote
USD 34.000 - 69.000
Remote Evaluation Reviewer — English Linguistic Specialist
Remote Evaluation Reviewer — English Linguistic Specialist

AuraOne Human Data • USA

Remote
USD 62.000 - 83.000
NZ English Linguistic Expert for AI Research (Part-Time)
NZ English Linguistic Expert for AI Research (Part-Time)

Mercor • USA

Remote
USD 45.000 - 65.000
English Language Expert (Great Britain) — Remote AI Evaluation
English Language Expert (Great Britain) — Remote AI Evaluation

AuraOne Human Data • USA

Remote
USD 28.000 - 41.000