British English Voice Evaluation Specialist

AuraOne; United States; À distance; USD 57 000 - 81 000; Plein temps

Résumé du poste

AuraOne is seeking a British English Voice Expert for remote AI audio evaluation. You will review prompts and model outputs, apply a versioned rubric, and provide structured feedback to help retrain the system.

As a contractor, you will compare paired responses, label edge cases, and document failure modes with clear rationales. Strong attention to detail and excellent written reasoning are essential for success in this role.

Qualifications

• Prior evaluation, annotation, or human-rater experience on British English voice evaluation.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause.

Responsabilités

• Evaluate British English voice evaluation model outputs against a rubric and assign severity tags.
• Compare paired responses and provide rationale for the stronger answer.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Document recurring failure modes and propose rubric updates.
• Maintain reviewer quality scores by calibrating against gold-standard examples.
• Audit batches for rubric consistency and report drift.

Connaissances

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

British English

Description du poste

AuraOne is seeking a British English Voice Expert for remote AI audio evaluation. You will review prompts and model outputs, apply a versioned rubric, and provide structured feedback to help retrain the system.

As a contractor, you will compare paired responses, label edge cases, and document failure modes with clear rationales. Strong attention to detail and excellent written reasoning are essential for success in this role.