Remote Voice QA Evaluator — Model Output Feedback

AI Trainer Jobs; United States; Remote; USD 57,000 - 81,000; Full time

Job summary

AuraOne is seeking remote evaluators to review voice actors evaluation prompts and responses against our quality rubric. You will compare outputs, label edge cases, and provide structured feedback for model retraining as part of a remote, contractor-based role.

Role emphasizes rubric-based annotation, issue naming, and inter-rater calibration. The position requires clear written reasoning and reliable async availability for at least 10 hours per week, with pay set per hour and flexible placement

Qualifications

• Experience evaluating voice prompts and responses against rubrics.
• Strong attention to detail and consistency in labeling.
• Ability to write clear, structured feedback.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate voice actors evaluation model outputs against a versioned rubric and assign severity tags for Voice Actors assignments.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

Skills

Voice evaluation experience

Attention to detail

Written reasoning skills

Async availability

Job description

AuraOne is seeking remote evaluators to review voice actors evaluation prompts and responses against our quality rubric. You will compare outputs, label edge cases, and provide structured feedback for model retraining as part of a remote, contractor-based role.

Role emphasizes rubric-based annotation, issue naming, and inter-rater calibration. The position requires clear written reasoning and reliable async availability for at least 10 hours per week, with pay set per hour and flexible placement