Remote Visual Grounding Evaluator

AI Trainer Jobs; United States; Remote; USD 25,000 - 39,000; Part time

Job summary

AuraOne is seeking a Visual Grounding Evaluator to remotely review prompts and model outputs, scoring them against our quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to help retrain the model.

As an independent contractor, you’ll assess visual grounding tasks, annotate with severity tags, and help calibrate performance weekly. Strong attention to detail and clear written reasoning are essential for this role.

Qualifications

• Prior evaluation, annotation, or human-rater experience on visual grounding evaluation or adjacent content.
• Ability to apply rubrics consistently across long batches and multi-page rubrics.

Responsibilities

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route for rubric updates.
• Maintain reviewer-quality scores through calibration against gold-standard examples.

Skills

Visual grounding

Rubric annotation

Severity tagging

Inter-rater calibration

Video QA

Computer vision

Spatial reasoning

Job description

AuraOne is seeking a Visual Grounding Evaluator to remotely review prompts and model outputs, scoring them against our quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to help retrain the model.

As an independent contractor, you’ll assess visual grounding tasks, annotate with severity tags, and help calibrate performance weekly. Strong attention to detail and clear written reasoning are essential for this role.