Remote Video Content Evaluator & Rubric Specialist

Auraone

United States

Remote

USD 21,000 - 34,000

Part time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AI Trainer Jobs is seeking a Data Annotator - Video Content for a remote evaluation track to assess prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback for retraining.

Responsibilities include evaluating model outputs against rubric, tagging content issues, maintaining calibration against gold standards, and routing ambiguous prompts to the program team for rubric updates.

Responsibilities

  • Evaluate data annotator video content evaluation outputs against a versioned rubric and assign severity tags.
  • Compare paired responses and select the stronger answer with written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route to program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

Job description

AI Trainer Jobs is seeking a Data Annotator - Video Content for a remote evaluation track to assess prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback for retraining.

Responsibilities include evaluating model outputs against rubric, tagging content issues, maintaining calibration against gold standards, and routing ambiguous prompts to the program team for rubric updates.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Data Evaluator for Model Feedback & Rubrics
Remote Data Evaluator for Model Feedback & Rubrics

Auraone • United States

Remote
USD 21,000 - 34,000
Remote Video Annotation Quality Reviewer
Remote Video Annotation Quality Reviewer

Auraone • United States

Remote
USD 28,000 - 55,000
Remote Video Data Annotation Evaluator & Rubric Specialist
Remote Video Data Annotation Evaluator & Rubric Specialist

Auraone • United States

Remote
USD 28,000 - 41,000
Remote Data-Video Evaluation Specialist
Remote Data-Video Evaluation Specialist

Auraone • United States

Remote
USD 34,000 - 55,000
Remote AI Data Evaluator: Video Review & Rubric Feedback
Remote AI Data Evaluator: Video Review & Rubric Feedback

AuraOne, Inc. • United States

Remote
USD 34,000 - 55,000
Remote AI Data Evaluator: Video Recorder Evaluation
Remote AI Data Evaluator: Video Recorder Evaluation

AuraOne Human Data • United States

Remote
USD 28,000 - 41,000
Remote Video AI Evaluation Specialist
Remote Video AI Evaluation Specialist

Auraone • United States

Remote
USD 34,000 - 55,000
Remote Video Editing Evaluation Specialist
Remote Video Editing Evaluation Specialist

Auraone • United States

Remote
USD 57,000 - 81,000
Remote work
US-eligible
Remote Video Annotation Evaluator — AI Data Labeling
Remote Video Annotation Evaluator — AI Data Labeling

AuraOne Human Data • United States

Remote
USD 21,000 - 34,000
Remote Video Data Evaluator & Rubric Annotator
Remote Video Data Evaluator & Rubric Annotator

Auraone • United States

Remote
USD 28,000 - 41,000