Brand Design Evaluation Architect

Mercor; Sydney; On-site; AUD 90,000 - 130,000; Full time

Job summary

Mercor is partnering with a leading AI research organization to engage experienced brand designers for a project focused on evaluating how well AI systems perform real-world brand and design work.

Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications.

Qualifications

• 5+ years of professional experience in brand, visual, or graphic design
• Background specifically at world-class independent brand and design agencies
• Experience in one of the core brand disciplines: Creative Director, Brand Designer, Web Designer, or Graphic Designer
• Deep fluency in typography, layout and visual hierarchy, color, composition, logo and brand identity systems
• Exceptional written communication; ability to explain why work meets or misses the bar
• Detail-oriented with peer-reviewed judgment calibration
• Copywriting and brand messaging experience is a plus
• Experience with AI training, evaluation, or human-data projects is a plus

Responsibilities

• Design precise, task-specific grading criteria for real-world brand design deliverables (brand identity systems and guidelines, logos and visual identity, campaign and marketing visuals, packaging concepts, presentation and layout design, digital and social assets, and brand messaging and positioning)
• Score AI-generated and human work samples against those criteria, with detailed written justifications for every score
• Apply consistent, evidence-based judgment so that scores are reproducible and defensible
• Incorporate structured feedback from senior reviewers and iterate quickly on your work

Skills

Brand design

Typography

Layout & visual hierarchy

Color theory

Logo design

Brand identity systems

Written communication

Critique & review

Job description

Mercor is partnering with a leading AI research organization to engage experienced brand designers for a project focused on evaluating how well AI systems perform real-world brand and design work.

Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications.