Remote English Audio Evaluation Specialist

Auraone

United States

Remote

USD 58,000 - 80,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AI Trainer Jobs is seeking an English Audio Recording Expert (AUS) to work remotely reviewing audio prompts and responses against AuraOne's rubric. You will compare paired outputs, label edge cases, and provide structured feedback that the modeling team can use to retrain.

As a remote independent contractor, you will evaluate model outputs, annotate according to a versioned rubric, and participate in ongoing calibration to maintain high reviewer quality.

Qualifications

  • Experience with audio annotation work for English prompts.
  • Ability to apply rubrics consistently across long batches.
  • Strong written reasoning naming the issue and rubric clause.

Responsibilities

  • Evaluate audio annotation model outputs against a versioned rubric and assign severity tags for assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

Skills

Audio annotation
Rubric-based evaluation
Inter-rater calibration
Quality review
Written reasoning

Job description

AI Trainer Jobs is seeking an English Audio Recording Expert (AUS) to work remotely reviewing audio prompts and responses against AuraOne's rubric. You will compare paired outputs, label edge cases, and provide structured feedback that the modeling team can use to retrain.

As a remote independent contractor, you will evaluate model outputs, annotate according to a versioned rubric, and participate in ongoing calibration to maintain high reviewer quality.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote English (India) AI Evaluation Specialist
Remote English (India) AI Evaluation Specialist

Auraone • United States

Remote
USD 34,000 - 55,000
Remote English Audio Annotation Specialist (UK)
Remote English Audio Annotation Specialist (UK)

AuraOne Human Data • United States

Remote
USD 34,000 - 62,000
Remote English Voice Evaluation Specialist
Remote English Voice Evaluation Specialist

Auraone • United States

Remote
USD 58,000 - 80,000
Remote English Voice Evaluation Specialist (US Contractor)
Remote English Voice Evaluation Specialist (US Contractor)

AuraOne Human Data • United States

Remote
USD 21,000 - 34,000
Remote AI Voice QA Evaluator (American English)
Remote AI Voice QA Evaluator (American English)

Auraone • United States

Remote
USD 69,000 - 83,000
Remote AU English Evaluator & Rubric Reviewer
Remote AU English Evaluator & Rubric Reviewer

AuraOne Human Data • United States

Remote
USD 45,000 - 65,000
Remote contractor
US-eligible
Contractor role
+1
Remote Pronunciation Audio QA Specialist
Remote Pronunciation Audio QA Specialist

AuraOne, Inc. • United States

Remote
USD 28,000 - 41,000
Remote AI Audio Evaluation & Feedback Specialist
Remote AI Audio Evaluation & Feedback Specialist

AuraOne Human Data • United States

Remote
USD 96,000 - 165,000
English Audio Recording Expert (AUS)
English Audio Recording Expert (AUS)

Auraone • United States

Remote
USD 58,000 - 80,000
Remote English Language Evaluator for AI Rubric QA & Feedback
Remote English Language Evaluator for AI Rubric QA & Feedback

AuraOne Human Data • United States

Remote
USD 28,000 - 41,000