Remote Voice Actors Prompt Evaluator

AI Trainer Jobs; United States; Remote; USD 55,000 - 83,000; Full time

Benefits offered by this job

Remote work

US eligibility

Job summary

AuraOne is seeking a remote data evaluator to review voice actors prompt writter evaluation outputs against a defined quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to help retrain the model.

The role focuses on labeling hallucinations, instruction-following failures, and unsafe content, with weekly calibration against gold standards. This is a contractor position offering hourly compensation and requires US-based eligibility.

Qualifications

• Experience evaluating voice prompts or similar tasks.
• Ability to apply multi-page rubrics consistently.
• Clear written reasoning citing rubric clauses.

Responsibilities

• Evaluate model outputs against rubric and assign severity tags.
• Compare paired responses and select stronger answer with rationale.
• Tag unsafe content and policy categories.
• Calibrate scores against gold-standard examples weekly.

Skills

Evaluation experience

Annotation experience

Inter-rater calibration

Attention to detail

Asynchronous work

Education

Linguistics background

Content moderation experience

Tools

Rubric-based annotation tools

Job description

AuraOne is seeking a remote data evaluator to review voice actors prompt writter evaluation outputs against a defined quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to help retrain the model.

The role focuses on labeling hallucinations, instruction-following failures, and unsafe content, with weekly calibration against gold standards. This is a contractor position offering hourly compensation and requires US-based eligibility.