Remote Voice AI Evaluation Specialist (Contractor)

AuraOne, Inc.; United States; Remote; USD 57,000 - 81,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Job summary

AuraOne, Inc. seeks a remote contractor to review voice actor CX Agent Voice Cloning Northern UK evaluation outputs. You will label and rate outputs, compare paired responses, and provide structured feedback to retrain the model.

Responsibilities include applying rubrics, identifying edge cases, and maintaining calibration against gold standards. Flexible hours with US-eligible remote work are offered.

Qualifications

• Prior evaluation, annotation, or human-rater experience on voice actor CX Agent Voice Cloning - Northern UK evaluation or adjacent content.

Responsibilities

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and write a rationale for the stronger answer.
• Label hallucinations and unsafe content with structured tags.
• Capture ambiguous prompts and route to the program team for rubric updates.
• Calibrate reviewer quality scores against gold-standard examples weekly.
• Document recurring failure modes for targeted retraining.

Skills

Model evaluation

Rubric annotation

Severity tagging

Inter-rater calibration

Voice cloning evaluation

Job description

AuraOne, Inc. seeks a remote contractor to review voice actor CX Agent Voice Cloning Northern UK evaluation outputs. You will label and rate outputs, compare paired responses, and provide structured feedback to retrain the model.

Responsibilities include applying rubrics, identifying edge cases, and maintaining calibration against gold standards. Flexible hours with US-eligible remote work are offered.