Remote Speech & Audio QA Specialist

AuraOne; United States; Remote; USD 28,000 - 55,000; Full time

Job summary

AI Trainer Jobs is seeking remote Speech and Audio Quality Evaluator contractors to review audio annotation prompts and responses against AuraOne's quality rubric. You will compare paired outputs, label edge cases, and craft structured feedback to retrain models.

Judge voice agents and speech recognition, focusing on pronunciation and conversation quality. Role details indicate a remote independent contractor position with hourly compensation to be confirmed after the interview.

Qualifications

• Experience evaluating audio annotation or related content.
• Ability to apply rubrics consistently across large batches.
• Strong written reasoning to name issues and rubric clauses.

Responsibilities

• Evaluate audio annotation model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route to the program team for rubric updates.
• Maintain reviewer-quality scores by calibration against gold-standard examples.

Skills

Audio annotation experience

Inter-rater calibration

Attention to detail

Written reasoning

Job description

AI Trainer Jobs is seeking remote Speech and Audio Quality Evaluator contractors to review audio annotation prompts and responses against AuraOne's quality rubric. You will compare paired outputs, label edge cases, and craft structured feedback to retrain models.

Judge voice agents and speech recognition, focusing on pronunciation and conversation quality. Role details indicate a remote independent contractor position with hourly compensation to be confirmed after the interview.