Remote Language & AI Voice Evaluator — Quality Feedback

AI Trainer Jobs; United States; Remote; USD 28,000 - 41,000; Part time

Benefits offered by this job

Remote work

US contractor eligibility

Job summary

AuraOne is seeking a Language & AI Voice Evaluator to remotely review language AI prompts and responses against the company rubric. Reviewers compare paired outputs, label edge cases, and write structured feedback the modeling team can use to retrain.

AI data reviewers help turn evaluations into auditable labels, rationales, and regression cases for AuraOne Human Data. Pronunciation and conversation quality are included in assessment.

Qualifications

• Prior evaluation, annotation, or human-rater experience on language AI voice evaluation.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause used.

Responsibilities

• Evaluate model outputs against a rubric and assign severity tags.
• Compare paired responses and provide a justified selection.
• Label hallucinations and safety issues with structured tags.
• Flag prompts for rubric updates and calibration needs.
• Maintain reviewer quality scores against gold standards.

Skills

Evaluation experience

Annotation

Rubric calibration

Written reasoning

Attention to detail

Async availability

Job description

AuraOne is seeking a Language & AI Voice Evaluator to remotely review language AI prompts and responses against the company rubric. Reviewers compare paired outputs, label edge cases, and write structured feedback the modeling team can use to retrain.

AI data reviewers help turn evaluations into auditable labels, rationales, and regression cases for AuraOne Human Data. Pronunciation and conversation quality are included in assessment.