Remote Voice Data Quality Analyst

AuraOne; United States; Remote; USD 25,000 - 39,000; Part time

Job summary

AI Trainer Jobs is seeking a remote Voice Data Contributor to review and evaluate voice data contributor prompts and responses against a quality rubric. You will judge voice agents and speech recognition, label issues, and provide structured feedback for retraining.

The role involves comparing outputs, tagging for sensitivity and accuracy, and maintaining calibration against gold-standard examples. Remote, independent contractor, hourly rate post-interview, US eligibility.

Qualifications

• Experience evaluating voice data using versioned rubrics.
• Ability to apply rubric clauses to prompts and outputs.
• Strong written reasoning to name issues and rubric clauses.

Responsibilities

• Evaluate outputs against rubric and assign severity tags.
• Compare paired responses and select the stronger with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and route to program team for rubric updates.
• Calibrate reviewer scores against gold-standard examples weekly.

Skills

Model evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Voice data evaluation

Language and multimodal

AI evaluation

Rubric writing

Expert review

Job description

AI Trainer Jobs is seeking a remote Voice Data Contributor to review and evaluate voice data contributor prompts and responses against a quality rubric. You will judge voice agents and speech recognition, label issues, and provide structured feedback for retraining.

The role involves comparing outputs, tagging for sensitivity and accuracy, and maintaining calibration against gold-standard examples. Remote, independent contractor, hourly rate post-interview, US eligibility.