Remote Voice Actor Evaluator & Annotation Specialist

AI Trainer Jobs; United States; Remote; USD 62,000 - 83,000; Full time

Benefits offered by this job

Remote work

Contractor

US eligible

Job summary

AuraOne seeks remote evaluators to review Voice Actor CX Agent voice cloning prompts and responses, applying a fixed rubric to ensure quality. This contractor role involves evaluating outputs, labeling issues, and providing structured feedback to retrain models.

You will compare multi-output responses, write concise rationales, and help identify edge cases for ongoing improvement in a remote setting, with US-eligibility for contractors.

Qualifications

• Experience evaluating voice actor outputs using rubrics.
• Strong ability to annotate and tag issues clearly.
• Experience calibrating multiple raters to ensure consistency.

Responsibilities

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger with written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and escalate for rubric updates.

Skills

Voice evaluation

Annotation

Inter-rater calibration

Job description

AuraOne seeks remote evaluators to review Voice Actor CX Agent voice cloning prompts and responses, applying a fixed rubric to ensure quality. This contractor role involves evaluating outputs, labeling issues, and providing structured feedback to retrain models.

You will compare multi-output responses, write concise rationales, and help identify edge cases for ongoing improvement in a remote setting, with US-eligibility for contractors.