Remote Data-Video Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Full time

Job summary

AI Trainer Jobs is seeking a Data-Video Generalist (US-based) for a remote evaluation track. You will review data video generalist prompts and responses against AuraOne's rubric, compare paired outputs, label edge cases, and provide structured feedback to retrain the model.

As a contractor, you will assess model outputs, tag content for policy and quality, and calibrate judgments against gold-standard examples on a weekly cadence.

Qualifications

• Prior evaluation, annotation, or human‑rater experience on data video generalist evaluation or adjacent content.
• Clear written reasoning that names issues and rubric clauses.
• Comfort applying multi‑page rubrics to long batches.

Responsibilities

• Evaluate data video generalist evaluation model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with a rationale.

Skills

Data‑video evaluation

Rubric‑based annotation

Inter‑rater calibration

Attention to detail

Written reasoning

Async availability

Job description

AI Trainer Jobs is seeking a Data-Video Generalist (US-based) for a remote evaluation track. You will review data video generalist prompts and responses against AuraOne's rubric, compare paired outputs, label edge cases, and provide structured feedback to retrain the model.

As a contractor, you will assess model outputs, tag content for policy and quality, and calibrate judgments against gold-standard examples on a weekly cadence.