Image Quality Analyst - Expert

Mercor; New York (NY); Remote; USD 39,000 - 44,000; Full time

Job summary

Obsidian is seeking contributors for Image SxS Analysis, a project where expert raters compare pairs of AI-generated images blinded to model identities and select a preferred image. You review two images against the original prompt, weighing prompt alignment, visual quality, anatomy and structure, rendered text, and artifacts.

Provide a concise rationale for your choice. Onboarding quiz pays $20; successful pass leads to tasks at $30/hr in the United States.

Qualifications

• Fluent English is required.
• Sharp eye for visual detail and the ability to explain reasoning in writing.

Responsibilities

• Review two images paired against the original prompt and select a winner or note both as good/bad.
• Provide a short written rationale explaining your choice.
• Adhere to the project guidelines and maintain consistency in judgments.

Skills

Attention to detail

Fluent English

Clear written reasoning

Job description

Image SxS Analysis is a project in which expert raters compare pairs of AI-generated images built from the same prompt and select a preferred image, with model identities blinded.

For each task you'll review two images side by side against the original prompt and judge which one is better overall, weighing prompt alignment, visual quality, anatomy and structure, rendered text, and artifacts. You'll pick a preference (or mark both good or both bad) and write a short rationale explaining your choice. Careful, consistent judgment matters more than speed.

You'll start with a paid onboarding quiz ($20, whether you pass or not). Pass it and you move onto project tasks at $30/hr.

Requirements: fluent English, a sharp eye for visual detail, and the ability to explain your reasoning clearly in writing. No specialist degree required.