Remote Visual Design QA & Feedback Specialist

AI Trainer Jobs; United States; Remote; USD 136,000 - 194,000; Part time

Job summary

AuraOne is seeking a Visual Design Professional to join its remote evaluation track. Reviewers assess visual design prompts and responses against AuraOne's quality rubric, compare paired outputs, label edge cases, and provide structured feedback for retraining.

Responsibilities include evaluating model outputs, tagging issues with the correct rubric, and calibrating scores weekly. This contractor role requires strong attention to detail and clear rationale, with a remote arrangement and US

Qualifications

• Prior evaluation, annotation, or human-rater experience in visual design evaluation.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the issue and the rubric clause being applied.
• Reliable async availability for at least 10 hours per week.
• Background in linguistics, content moderation, or trust & safety review.

Responsibilities

• Evaluate visual design evaluation model outputs against a versioned rubric and assign severity tags for Visual Design Professional assignments.
• Compare paired responses and pick the stronger answer with a written rationale.
• Label hallucinations, instruction-following failures, and unsafe content with structured tags.
• Capture ambiguous prompts and route them back to the program team for rubric updates.
• Maintain reviewer-quality scores by calibrating against gold-standard examples each week.

Skills

Attention to detail

Written reasoning

Async availability

Inter-rater calibration

Visual design evaluation

Rubric-based annotation

Job description

AuraOne is seeking a Visual Design Professional to join its remote evaluation track. Reviewers assess visual design prompts and responses against AuraOne's quality rubric, compare paired outputs, label edge cases, and provide structured feedback for retraining.

Responsibilities include evaluating model outputs, tagging issues with the correct rubric, and calibrating scores weekly. This contractor role requires strong attention to detail and clear rationale, with a remote arrangement and US