AI Model Policy Trainer – Image Evaluation

Jobtailor; Seattle (WA); On-site; USD 60,000 - 90,000; Full time

Job summary

Jobtailor in Seattle, WA seeks a meticulous image evaluator to assess AI-generated content, compare prompts and results, and document evidence-based judgments.

You will apply customer policies on sexual content, violence, IP, and likeness, explain decisions in writing, and help refine prompts for model testing.

Qualifications

• Deep visual judgement across photography, illustration, concept art, or visual content moderation.
• Ability to assess adherence, realism, style consistency, and technical defects.
• Experience with generative image tools and policy classifications.

Responsibilities

• Evaluate generated images against prompts for adherence and quality.
• Compare images side by side and justify the stronger choice with evidence.
• Classify images under policy rubrics and write concise rationales.

Tools

Midjourney

Stable Diffusion

ComfyUI

Flux

DALL-E

Ideogram

Job description

• Evaluate generated images against prompts for adherence, composition, realism, style consistency, and technical defects
• Compare images side by side and select the stronger image with an evidence-based rationale
• Classify images under customer policies covering sexual content, violence, hate symbols, real-person likeness, intellectual property, and depictions of minors
• Select defensible classifications for ambiguous images and write concise rationales citing rubric language and visual details
• Separate prompt failure, policy violation, and personal preference judgments
• Write and refine prompts to test model quality and safety boundaries
• Identify rubric gaps, contradictions, and emerging edge cases and raise them with project leads and policy teams
• Participate in calibration discussions and update judgments based on stronger reasoning
• Apply customer policy consistently without substituting personal taste or beliefs
• Maintain accuracy and consistency across hundreds of visually similar evaluations
• Engage regularly with sensitive imagery within structured evaluation frameworks and professional guidelines

Requirements

• Deep visual judgment from photography, illustration, concept art, art direction, retouching, photo editing, VFX, visual design, generative image tools, or visual content moderation
• Ability to evaluate image adherence, composition, realism, style consistency, and technical defects
• Familiarity with generative image tools such as Midjourney, Stable Diffusion, ComfyUI, Flux, DALL-E, and Ideogram
• Knowledge of generative image model failure modes, prompt quirks, and safety-filter bypasses
• Experience moderating or reviewing visual content at scale and applying policy taxonomies under time pressure
• Ability to identify subtle visual details such as extra fingers, mismatched shadows, brand marks, and recognizable faces
• Ability to maintain rubric consistency across hundreds of similar evaluations
• Ability to explain judgment calls clearly and precisely in writing
• Ability to distinguish personal taste from customer standards
• Maturity and sound judgment when handling sensitive imagery and difficult subject matter
• Ability to engage with sensitive material carefully, responsibly, and sustainably
• A degree and technical background are not required
• Prior AI evaluation experience is helpful but not required
• Must be authorized to work lawfully in the United States for Handshake
• Must work 8AM–5PM PT, Monday through Friday

Core Competencies

Demonstrates deep visual judgment and the ability to evaluate image adherence, composition, realism, and technical defects while applying customer policies consistently. Engages with sensitive imagery responsibly and maintains rubric consistency across evaluations.

Highest-signal resume keywords

• Visual Judgment
• Generative Image Tools
• Content Moderation Experience
• Policy Application
• Attention to Detail

Hard Skills

• Image Evaluation
• Composition Analysis
• Technical Defect Identification
• Prompt Writing
• Policy Classification

Soft Skills

• Clear Communication
• Sound Judgment
• Maturity

Industry Keywords

• Visual Content Moderation
• Generative Image Models
• Policy Taxonomies
• Sensitive Imagery Handling

Tools & Technologies

• Midjourney
• Stable Diffusion
• ComfyUI
• Flux
• DALL-E
• Ideogram