Remote English Voice Evaluation Specialist (US)

AuraOne Human Data

United States

Remote

USD 30,000 - 44,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne, Inc. is hiring an English Voice Expert (US) to work remotely as an independent contractor. You will review English voice evaluation prompts and responses, applyingAuraOne's quality rubric and providing structured feedback to retrain the model.

Responsibilities include comparing outputs, labeling issues, and capturing edge cases for ongoing rubric improvements, with weekly calibration against gold-standard samples to maintain high-quality assessments.

Qualifications

  • Experience in evaluating model outputs against rubrics and producing actionable feedback.
  • Ability to name rubric clauses clearly in written reasoning.
  • Attention to detail and ability to flag when prompts themselves drive issues.

Responsibilities

  • Evaluate English voice evaluation model outputs against a versioned rubric and assign severity tags.
  • Compare paired responses and select the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Calibrate reviewer-quality scores against gold-standard examples weekly.
  • Document recurring failure modes to guide future training.

Skills

Model output evaluation
Rubric-based annotation
Severity tagging
Inter-rater calibration
English Voice evaluation

Job description

AuraOne, Inc. is hiring an English Voice Expert (US) to work remotely as an independent contractor. You will review English voice evaluation prompts and responses, applyingAuraOne's quality rubric and providing structured feedback to retrain the model.

Responsibilities include comparing outputs, labeling issues, and capturing edge cases for ongoing rubric improvements, with weekly calibration against gold-standard samples to maintain high-quality assessments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote English Voice Evaluation Specialist (US Contractor)
Remote English Voice Evaluation Specialist (US Contractor)

AuraOne Human Data • United States

Remote
USD 21,000 - 34,000
Remote English Voice Evaluation Specialist
Remote English Voice Evaluation Specialist

Auraone • United States

Remote
USD 58,000 - 80,000
British English Voice Evaluation Specialist — Remote
British English Voice Evaluation Specialist — Remote

Auraone • United States

Remote
USD 62,000 - 76,000
Remote English Audio Annotation Specialist (UK)
Remote English Audio Annotation Specialist (UK)

AuraOne Human Data • United States

Remote
USD 34,000 - 62,000
Remote English Audio Evaluation Specialist
Remote English Audio Evaluation Specialist

Auraone • United States

Remote
USD 58,000 - 80,000
Remote Voice Evaluation Expert (Contractor)
Remote Voice Evaluation Expert (Contractor)

AuraOne Human Data • United States

Remote
USD 25,000 - 39,000
Background in linguistics
Experience with inter-rater agreement
Domain expertise in trust & safety
English Voice Expert (US)
English Voice Expert (US)

AuraOne Human Data • United States

Remote
USD 21,000 - 34,000
Remote Voice Actor Evaluator & Annotation Specialist
Remote Voice Actor Evaluator & Annotation Specialist

Auraone • United States

Remote
USD 62,000 - 83,000
Remote work
Contractor
US eligible
Remote AI Voice QA Evaluator (American English)
Remote AI Voice QA Evaluator (American English)

Auraone • United States

Remote
USD 69,000 - 83,000
Remote English (India) AI Evaluation Specialist
Remote English (India) AI Evaluation Specialist

Auraone • United States

Remote
USD 34,000 - 55,000