Remote Video AI Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Full time

Job summary

AuraOne seeks a video-related professional to remotely evaluate AI training outputs against AuraOne's quality rubric. You will review video prompts and responses, compare paired outputs, label edge cases, and write structured feedback for the modeling team.

Independent contractor role with hourly pay after interview. You will work asynchronously on task batches, ensure rubric consistency, and help identify issues to improve AI training data. Remote from the US, part-time hours available.

Qualifications

• Experience evaluating video outputs against rubrics.
• Ability to annotate and label edge cases with rationale.
• Experience with inter-rater calibration and rubric consistency.

Responsibilities

• Evaluate video outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger with written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route to the program team for rubric updates.

Skills

Video evaluation

Annotation

Inter-rater calibration

Attention to detail

Written reasoning

Async availability

Job description

AuraOne seeks a video-related professional to remotely evaluate AI training outputs against AuraOne's quality rubric. You will review video prompts and responses, compare paired outputs, label edge cases, and write structured feedback for the modeling team.

Independent contractor role with hourly pay after interview. You will work asynchronously on task batches, ensure rubric consistency, and help identify issues to improve AI training data. Remote from the US, part-time hours available.