Remote Video Evaluation & Annotation Specialist

AI Trainer Jobs; United States; Remote; USD 21,000 - 34,000; Full time

Benefits offered by this job

Hourly rate confirmed after interview

Remote work

Job summary

AuraOne is seeking a Video Capture & Annotation Specialist for a remote evaluation track. You will review video capture annotation outputs against the quality rubric, compare paired results, label edge cases, and provide structured feedback to retrain models.

You will contextualize assessments, tag issues, and contribute to calibration cycles while working as an independent contractor on a remote program. An hourly arrangement applies after interview.

Qualifications

• Prior evaluation, annotation, or human-rater experience on video capture evaluation or adjacent content.

Responsibilities

• Evaluate model outputs against a versioned rubric and tag severity.
• Compare paired responses and select the stronger answer with written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with tags.
• Capture ambiguous prompts and route to program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples weekly.

Skills

Video annotation

Rubric-based evaluation

Inter-rater calibration

Attention to detail

Job description

AuraOne is seeking a Video Capture & Annotation Specialist for a remote evaluation track. You will review video capture annotation outputs against the quality rubric, compare paired results, label edge cases, and provide structured feedback to retrain models.

You will contextualize assessments, tag issues, and contribute to calibration cycles while working as an independent contractor on a remote program. An hourly arrangement applies after interview.