Remote AI Model Output Evaluator - Photoshop on Windows

AI Trainer Jobs; United States; Remote; USD 41,000 - 55,000; Full time

Job summary

AI Trainer Jobs is seeking remote contractors to review Application Users - Photoshop on Windows - Generalist prompts and responses, evaluating them against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback to retrain the model.

As a reviewer, you will flag hallucinations, instruction-following failures, and unsafe content, and capture ambiguous prompts for rubric updates.

Qualifications

• Experience evaluating model outputs against rubrics.
• Ability to apply rubrics consistently across long batches.
• Clear written reasoning with rubric clause references.

Responsibilities

• Evaluate model outputs against rubric and assign severity tags.
• Compare paired responses and select the stronger with rationale.
• Label hallucinations, instruction-following failures, and unsafe content.
• Capture ambiguous prompts and escalate rubric updates.

Skills

Evaluation experience

Annotation

Human evaluator

Attention to detail

Job description

AI Trainer Jobs is seeking remote contractors to review Application Users - Photoshop on Windows - Generalist prompts and responses, evaluating them against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and provide structured feedback to retrain the model.

As a reviewer, you will flag hallucinations, instruction-following failures, and unsafe content, and capture ambiguous prompts for rubric updates.