Remote Visual Media Evaluator: AI Quality & Feedback

AI Trainer Jobs; United States; Remote; USD 28,000 - 55,000; Part time

Benefits offered by this job

Remote work

Job summary

AI Trainer Jobs is seeking a Visual Media Evaluator to work remotely on AuraOne's quality rubric. You will review prompts and responses, compare outputs, label edge cases, and write structured feedback for retraining the model.

The role is a remote contractor with US-eligible placement; compensation is hourly and confirmed after the interview process. You will assess visual media outputs, judge spatial reasoning, and contribute to calibration and rubric updates.

Qualifications

• Experience with annotation or data labeling workflows.
• Ability to apply rubrics consistently across long batches.
• Clear written reasoning naming the issue and rubric clause.
• Strong attention to detail and reliability in async work.

Responsibilities

• Evaluate visual media outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, policy violations, and unsafe content with structured tags.
• Capture ambiguous prompts and report for rubric updates.
• Maintain reviewer quality scores through calibration against gold standards.

Job description

AI Trainer Jobs is seeking a Visual Media Evaluator to work remotely on AuraOne's quality rubric. You will review prompts and responses, compare outputs, label edge cases, and write structured feedback for retraining the model.

The role is a remote contractor with US-eligible placement; compensation is hourly and confirmed after the interview process. You will assess visual media outputs, judge spatial reasoning, and contribute to calibration and rubric updates.