Remote Audio Transcription & Speaker-Diarization Reviewer

AI Trainer Jobs; United States; Remote; USD 21,000 - 34,000; Full time

Job summary

AuraOne is seeking a remote Audio Transcription and Speaker-Diarization Reviewer to evaluate model outputs against a versioned rubric, label edge cases, and provide structured feedback for retraining.

You will compare paired responses, tag hallucinations, and document rationale. This independent contractor role requires strong attention to detail, clear written reasoning, and reliable 10+ hours per week.

Qualifications

• Experience evaluating audio annotation or related content as a human rater.
• Ability consistently apply multi-page rubrics across large batches.

Responsibilities

• Evaluate audio outputs against the rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and route to improve rubrics.
• Calibrate reviewer quality against gold-standard examples weekly.

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Audio annotation

Voice, language and multimodal

AI evaluation

Rubric writing

Expert review

Job description

AuraOne is seeking a remote Audio Transcription and Speaker-Diarization Reviewer to evaluate model outputs against a versioned rubric, label edge cases, and provide structured feedback for retraining.

You will compare paired responses, tag hallucinations, and document rationale. This independent contractor role requires strong attention to detail, clear written reasoning, and reliable 10+ hours per week.