Remote Image Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 34,000 - 55,000; Full time

Job summary

AI Trainer Jobs is seeking a remote Image Evaluation Generalist reviewer. You will assess model outputs against a versioned rubric, label issues, and provide structured feedback to aid retraining.

The role involves judging image outputs, comparing responses, and tagging content for safety and instruction-following. Experience in evaluation or content moderation, strong writing skills, and the ability to work asynchronously for at least 10 hours weekly are essential.

Qualifications

• Prior evaluation, annotation or human-rater experience on image evaluation generalist work.
• Ability to apply a multi-page rubric consistently across long batches.
• Clear written reasoning naming the issue and rubric clause applied.
• Strong attention to detail and capacity to flag prompt problems.
• Reliable async availability for at least 10 hours per week.

Responsibilities

• Evaluate model outputs against rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, policy violations, and unsafe content with tags.
• Capture ambiguous prompts and route to refine rubrics.
• Calibrate reviewer quality against gold-standard examples weekly.

Skills

Evaluation experience

Annotation

Attention to detail

Clear written reasoning

Async availability

Job description

AI Trainer Jobs is seeking a remote Image Evaluation Generalist reviewer. You will assess model outputs against a versioned rubric, label issues, and provide structured feedback to aid retraining.

The role involves judging image outputs, comparing responses, and tagging content for safety and instruction-following. Experience in evaluation or content moderation, strong writing skills, and the ability to work asynchronously for at least 10 hours weekly are essential.