Remote British English Voice Actor Evaluator (Contractor)

AuraOne; United States; À distance; USD 52 000 - 72 000; Temps partiel

Résumé du poste

Qualifications

• Prior evaluation, annotation, or human-rater experience on British English voice actor evaluation.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause.
• Strong attention to detail and ability to flag prompts as problematic.
• Reliable async availability for at least 10 hours per week.

Responsabilités

• Evaluate outputs against rubric and assign severity tags.
• Compare paired responses and provide written rationale.
• Label hallucinations, instruction-following failures, unsafe content with tags.
• Capture ambiguous prompts and route back for rubric updates.
• Calibrate reviewer-quality scores against gold-standard examples weekly.
• Document recurring failure modes for model training.

Connaissances

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

British English Voice Actor evaluation

Description du poste