Remote Voice Evaluation Specialist - Rubric & QA

AI Trainer Jobs; United States; Remote; USD 57,000 - 81,000; Full time

Job summary

AuraOne is seeking a Voice Actor/Actress reviewer for a remote evaluation track. You will compare prompts and responses against our quality rubric, label edge cases, and provide structured feedback to help retrain models.

This paid contractor role offers flexible hours and US-eligible remote work. Responsibilities include evaluating model outputs, tagging issues, calibrating scores against gold standards, and reporting rubric drift.

Qualifications

• Must have prior evaluation, annotation, or human-rater experience on voice actor/actress evaluation or adjacent content.
• Ability to apply rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause is required.

Responsibilities

• Evaluate voice actor/actress evaluation model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route to the program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples weekly.

Skills

Evaluation experience

Annotation

Human rater experience

Quality rubric understanding

Job description

AuraOne is seeking a Voice Actor/Actress reviewer for a remote evaluation track. You will compare prompts and responses against our quality rubric, label edge cases, and provide structured feedback to help retrain models.

This paid contractor role offers flexible hours and US-eligible remote work. Responsibilities include evaluating model outputs, tagging issues, calibrating scores against gold standards, and reporting rubric drift.