Image Quality Analyst - Expert

Mercor; Toronto; On-site; CAD 36,000 - 47,000; Full time

Job summary

Obsidian is seeking qualified image evaluators to participate in the Image SxS Analysis project. You will compare two images produced from the same prompt, determine the better choice, and provide a concise written rationale explaining your decision.

Onboarding starts with a paid quiz ($20). Successful candidates then join project tasks at a rate of $30 per hour, with clear expectations for prompt alignment, visual fidelity, and artifact handling.

Qualifications

• Fluent English required.
• Sharp eye for visual detail.
• Ability to explain reasoning clearly in writing.
• No specialist degree required.

Responsibilities

• Review two AI-generated images against the original prompt.
• Judge which image is better overall based on prompt alignment, visual quality, anatomy and structure, rendered text, and artifacts.
• Provide a short rationale explaining your preference and write a concise justification.

Skills

Fluent English

Visual detail

Reasoning writing

Job description

Image SxS Analysis is a project in which expert raters compare pairs of AI-generated images built from the same prompt and select a preferred image, with model identities blinded.

For each task you'll review two images side by side against the original prompt and judge which one is better overall, weighing prompt alignment, visual quality, anatomy and structure, rendered text, and artifacts. You'll pick a preference (or mark both good or both bad) and write a short rationale explaining your choice. Careful, consistent judgment matters more than speed.

You'll start with a paid onboarding quiz ($20, whether you pass or not). Pass it and you move onto project tasks at $30/hr.

Requirements: fluent English, a sharp eye for visual detail, and the ability to explain your reasoning clearly in writing. No specialist degree required.