Remote Data-Video Evaluator (LATAM)

AI Trainer Jobs; United States; Remote; USD 28,000 - 55,000; Full time

Job summary

AuraOne is seeking a Data-Video Generalist for LATAM to review prompts and responses against an in-house rubric. You will evaluate outputs, label edge cases, and provide structured feedback to retrain models, ensuring alignment with quality standards.

The role focuses on reviewing paired outputs, labeling issues, and contributing to rubric calibration. This is a remote contractor position with an hourly rate to be confirmed after interview, eligible for US-based contractors.

Qualifications

• Experience in data-video evaluation or related content moderation.
• Ability to apply rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause.

Responsibilities

• Evaluate data-video generalist LATAM outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with a rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route to the program team for rubric updates.
• Calibrate reviewer quality against gold-standard examples weekly.

Job description

AuraOne is seeking a Data-Video Generalist for LATAM to review prompts and responses against an in-house rubric. You will evaluate outputs, label edge cases, and provide structured feedback to retrain models, ensuring alignment with quality standards.

The role focuses on reviewing paired outputs, labeling issues, and contributing to rubric calibration. This is a remote contractor position with an hourly rate to be confirmed after interview, eligible for US-based contractors.