Brand Design Evaluator & Criteria Architect

Mercor; New York (NY); Remote; USD 110,000 - 170,000; Full time

Job summary

Mercor is partnering with a leading AI research organization to engage experienced brand designers for a project focused on evaluating how well AI systems perform real-world brand and design work. You will define what excellent work looks like by creating grading criteria and scoring samples with well-reasoned written justifications.

The role emphasizes disciplined, evidence-based assessment and clear communication, with preference for candidates from top design agencies and strong craft in

Qualifications

• 5+ years of professional experience in brand, visual, or graphic design.
• Experience at world-class independent brand and design agencies (e.g., Pentagram, Wolff Olins, Landor, Collins, IDEO).
• Deep fluency in typography, layout and visual hierarchy, color, composition, and brand identity systems.
• Exceptionally strong written communication with ability to justify critique clearly.

Responsibilities

• Design precise, task-specific grading criteria for real-world brand design deliverables.
• Score AI-generated and human work samples against those criteria with detailed written justifications.
• Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and iterate quickly on your work.

Skills

Brand design

Agency experience

Copywriting

Written communication

Typography

Layout & visual hierarchy

Job description

Mercor is partnering with a leading AI research organization to engage experienced brand designers for a project focused on evaluating how well AI systems perform real-world brand and design work. You will define what excellent work looks like by creating grading criteria and scoring samples with well-reasoned written justifications.

The role emphasizes disciplined, evidence-based assessment and clear communication, with preference for candidates from top design agencies and strong craft in