Remote Visual Evaluation & Rubric Feedback Specialist

AI Trainer Jobs; United States; Remote; USD 27,552,000 - 49,594,000; Part time

Job summary

AuraOne seeks a Visual Evaluation Specialist for remote, contractor work. You will review prompts and responses, evaluate outputs, and provide structured feedback to retrain the model.

Expect to compare paired results, label edge cases, and document reasoning using a versioned rubric. Applicants should have prior evaluation experience, strong attention to detail, and reliable async availability for at least 10 hours per week.

Qualifications

• Prior evaluation, annotation, or human-rater experience in visual evaluation.
• Ability to apply rubrics consistently across long batches.
• Strong written reasoning that names issues and rubric clauses.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate model outputs against a versioned rubric and assign severity tags.
• Compare paired responses and select the stronger with rationale.
• Label hallucinations and unsafe content with structured tags.
• Capture ambiguous prompts and route for rubric updates.
• Maintain reviewer-quality scores by calibration against gold-standard examples.

Skills

Attention to detail

Clear written reasoning

Async availability

Linguistics background

Job description

AuraOne seeks a Visual Evaluation Specialist for remote, contractor work. You will review prompts and responses, evaluate outputs, and provide structured feedback to retrain the model.

Expect to compare paired results, label edge cases, and document reasoning using a versioned rubric. Applicants should have prior evaluation experience, strong attention to detail, and reliable async availability for at least 10 hours per week.