Visual Rater - Fully Remote | Up to $30/hr

Mercor; Toronto; Remote; CAD 34,000 - 48,000; Full time

Job summary

Obsidian is seeking contributors for Image SxS Analysis tasks in Toronto. You will compare AI-generated image pairs against prompts, judge overall quality, and provide a concise rationale for your choice. Applicants must be fluent in English and able to write clearly.

The onboarding quiz pays $20 regardless of outcome, followed by paid tasks at $30 per hour. No specialized degree is required; strong attention to detail and consistent judgment are essential.

Qualifications

• Fluent English with clear written communication.
• Sharp eye for visual detail and clear written explanations.
• No specialist degree required.

Responsibilities

• Review two AI-generated images per task and select a preferred image.
• Write a brief rationale explaining your choice.

Skills

Fluent English

Job description

Image SxS Analysis is a project in which expert raters compare pairs of AI-generated images built from the same prompt and select a preferred image, with model identities blinded.

For each task you'll review two images side by side against the original prompt and judge which one is better overall, weighing prompt alignment, visual quality, anatomy and structure, rendered text, and artifacts. You'll pick a preference (or mark both good or both bad) and write a short rationale explaining your choice. Careful, consistent judgment matters more than speed.

You'll start with a paid onboarding quiz ($20, whether you pass or not). Pass it and you move onto project tasks at $30/hr.

Requirements: fluent English, a sharp eye for visual detail, and the ability to explain your reasoning clearly in writing. No specialist degree required.