Visual Rater - Fully Remote | Up to $30/hr

Mercor; New York (NY); Remote; USD 28,000 - 41,000; Full time

Job summary

Obsidian is seeking reviewers for an Image SxS Analysis project. You will review two images generated from the same prompt and choose the preferred image based on alignment to the prompt, visual quality, anatomy and structure, and artifact handling.

You'll start with a paid onboarding quiz ($20). If you pass, you move on to project tasks at $30/hr, with fluent English and clear written explanations required.

Qualifications

• Fluent English is required.
• Sharp eye for visual detail.
• Ability to explain your reasoning clearly in writing.
• No specialist degree required.

Responsibilities

• Review two AI-generated images side by side against the original prompt and judge which is better overall.
• Assess prompt alignment, visual quality, anatomy and structure, rendered text, and artifacts.
• Provide a short written rationale for your choice.

Skills

Fluent English

Attention to detail

Clear reasoning in writing

Job description

Image SxS Analysis is a project in which expert raters compare pairs of AI-generated images built from the same prompt and select a preferred image, with model identities blinded.

For each task you'll review two images side by side against the original prompt and judge which one is better overall, weighing prompt alignment, visual quality, anatomy and structure, rendered text, and artifacts. You'll pick a preference (or mark both good or both bad) and write a short rationale explaining your choice. Careful, consistent judgment matters more than speed.

You'll start with a paid onboarding quiz ($20, whether you pass or not). Pass it and you move onto project tasks at $30/hr.

Requirements: fluent English, a sharp eye for visual detail, and the ability to explain your reasoning clearly in writing. No specialist degree required.