Remote AI Video Evaluation & Feedback Pro

AI Trainer Jobs; United States; Remote; USD 207,000 - 276,000; Part time

Job summary

UK-Based Video Producers & Editors is a remote evaluation role where reviewers assess prompts and responses against AuraOne's quality rubric. You will compare outputs, label edge cases, and draft structured feedback for retraining the modeling team.

As an AI data reviewer, you’ll label issues, provide rationales, and help create auditable evidence for quality assurance. Remote, contractor-based, $150–$200/hr, US-eligible.

Qualifications

• Prior evaluation, annotation, or human-rater experience on UK-based video producers & editors work.
• Ability to apply rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate model outputs against rubric and tag severity.
• Compare paired responses and provide written rationale.
• Label hallucinations, instruction-following failures, and unsafe content.
• Capture ambiguous prompts and route to program team for rubric updates.

Skills

Evaluation experience

Annotation

Rationale writing

Attention to detail

Async availability

Job description

UK-Based Video Producers & Editors is a remote evaluation role where reviewers assess prompts and responses against AuraOne's quality rubric. You will compare outputs, label edge cases, and draft structured feedback for retraining the modeling team.

As an AI data reviewer, you’ll label issues, provide rationales, and help create auditable evidence for quality assurance. Remote, contractor-based, $150–$200/hr, US-eligible.