Remote English Voice Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 57,000 - 81,000; Part time

Job summary

AuraOne seeks an English Voice Coaching Evaluation Specialist to remotely review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to retrain the model.

The role involves evaluating model outputs, annotating issues, and maintaining consistency across long batches. This is a remote contractor position, with hourly compensation and US eligibility.

Qualifications

• Prior evaluation, annotation, or human-rater experience on English voice coaching evaluation content.
• Clear written reasoning that names the issue and the rubric clause applied.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them for rubric updates.

Skills

Evaluation experience

Annotation experience

English voice coaching evaluation

Attention to detail

Written reasoning

Async availability

Job description

AuraOne seeks an English Voice Coaching Evaluation Specialist to remotely review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to retrain the model.

The role involves evaluating model outputs, annotating issues, and maintaining consistency across long batches. This is a remote contractor position, with hourly compensation and US eligibility.