Brand Design Evaluator & Standards Architect

Mercor; Greater London; Remote; GBP 60,000 - 90,000; Full time

Job summary

Mercor is partnering with a leading AI research organization to engage experienced brand designers for a project focused on evaluating how well AI systems perform real-world brand and design work. You will design task-specific grading criteria and provide rigorous written justifications for scores, shaping the standards used to judge both AI-generated and human work.

You will define what excellent work looks like and contribute to a rigorous evaluation process, ensuring scores are defensible and

Qualifications

• 5+ years of professional experience in brand, visual, or graphic design.
• Experience at world-class independent brand and design agencies (e.g., Pentagram, Wolff Olins, Landor, Collins, IDEO).
• Experience in core brand disciplines: Creative Director, Brand Designer, Web Designer, or Graphic Designer.
• Deep fluency in typography, layout and visual hierarchy, color, composition, logo and brand identity systems, and articulating critique.
• Exceptionally strong written communication, with the ability to explain why a piece does or does not meet the bar.
• Detail-oriented, consistent, and comfortable having judgment reviewed and calibrated against peers.
• Experience with copywriting and brand messaging—audience research, competitor research, and positioning is a strong plus.
• Prior experience with AI training, evaluation, or human-data projects is a strong plus.

Responsibilities

• Design precise, task-specific grading criteria for real-world brand design deliverables (brand identity systems and guidelines, logos and visual identity, campaign and marketing visuals, packaging concepts, presentation and layout design, digital and social assets, and brand messaging and positioning).
• Score AI-generated and human work samples against those criteria, with detailed written justifications for every score.
• Apply consistent, evidence-based judgment so that scores are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and iterate quickly on your work.

Skills

Brand design

Visual design

Graphic design

Creative critique

Job description

Mercor is partnering with a leading AI research organization to engage experienced brand designers for a project focused on evaluating how well AI systems perform real-world brand and design work. You will design task-specific grading criteria and provide rigorous written justifications for scores, shaping the standards used to judge both AI-generated and human work.

You will define what excellent work looks like and contribute to a rigorous evaluation process, ensuring scores are defensible and