Remote Data-Video Evaluator & Feedback Annotator

AI Trainer Jobs; United States; Remote; USD 28,000 - 41,000; Full time

Job summary

AuraOne is seeking remote contractors to serve as Data-Video Generalists (Household Task Video Contributors). You will review data video outputs, apply a consistent rubric, tag issues, and provide clear rationales to help retrain models.

This is a remote contractor role with US-eligibility and hourly compensation after interview. You should have prior evaluation or annotation experience, strong written reasoning, and the ability to work asynchronously for at least 10 hours weekly.

Qualifications

• Experience evaluating data video generalist outputs against a rubric.
• Ability apply multi-page rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause.
• Availability for at least 10 hours per week.

Responsibilities

• Evaluate data video generalist evaluation model outputs against a versioned rubric and assign severity tags for Data-Video Generalist assignments.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.

Skills

Evaluation experience

Annotation experience

Clear written reasoning

Async availability

Attention to detail

Tools

Annotation platforms

Job description

AuraOne is seeking remote contractors to serve as Data-Video Generalists (Household Task Video Contributors). You will review data video outputs, apply a consistent rubric, tag issues, and provide clear rationales to help retrain models.

This is a remote contractor role with US-eligibility and hourly compensation after interview. You should have prior evaluation or annotation experience, strong written reasoning, and the ability to work asynchronously for at least 10 hours weekly.