AI Voice Cloning Evaluations: Remote Quality Auditor

AuraOne, Inc.; United States; Remote; USD 69,000 - 138,000; Part time

Job summary

AuraOne, Inc. is seeking an independent contractor for a remote evaluation track titled Voice Actor: CX Agent Voice Cloning (South African English).

Reviewers assess model outputs against a living rubric, label edge cases, and provide structured feedback to retrain the system. Responsibilities include comparing paired responses, labeling unsafe content, flagging issues with rubric clauses, and calibrating against gold-standard examples weekly.

Qualifications

• Prior evaluation, annotation, or human-rater experience on voice actor CX agent voice cloning evaluation
• Comfort applying multi-page rubrics consistently across long batches
• Clear written reasoning that names the issue and the rubric clause being applied
• Strong attention to detail and the ability to flag when a prompt itself is the problem
• Reliable async availability for at least 10 hours per week

Responsibilities

• Evaluate model outputs against a versioned rubric and assign severity tags
• Compare paired responses and select the stronger answer with rationale
• Label hallucinations, instruction-following failures, and unsafe content with structured tags
• Capture ambiguous prompts and route them for rubric updates
• Maintain reviewer-quality scores by calibrating against gold-standard examples
• Document recurring failure modes for the training program

Skills

Model output evaluation

Rubric-based annotation

Severity tagging

Inter-rater calibration

Voice Actor CX Agent Voice Cloning

Job description

AuraOne, Inc. is seeking an independent contractor for a remote evaluation track titled Voice Actor: CX Agent Voice Cloning (South African English).

Reviewers assess model outputs against a living rubric, label edge cases, and provide structured feedback to retrain the system. Responsibilities include comparing paired responses, labeling unsafe content, flagging issues with rubric clauses, and calibrating against gold-standard examples weekly.