Brand Design Evaluator & AI Scoring Architect

Preferred Podiatry Group; Springfield (IL); On-site; USD 111,000 - 150,000; Full time

Job summary

Mercor partners with a leading AI research organization to hire experienced brand designers who will define grading criteria for real-world brand and design work. You will score both AI-generated and human samples, providing detailed written justifications for every score.

The role emphasizes reproducible, defensible judgments, iterative work with senior reviewers, and clear communication about why each piece meets or misses the bar.

Qualifications

• 5+ years of professional experience in brand, visual, or graphic design.
• Experience at world-class independent brand and design agencies (e.g., Pentagram, Wolff Olins, Landor, Collins, IDEO).
• Experience in core brand disciplines: Creative Director, Brand Designer, Web Designer, or Graphic Designer.
• Deep fluency in typography, layout and visual hierarchy, color, composition, and brand identity systems.
• Exceptional written communication and ability to explain why a piece does or does not meet the bar.
• Detail-oriented and comfortable with peer review and calibration.
• Experience with copywriting and brand messaging is a strong plus.
• Prior experience with AI training, evaluation, or human-data projects is a strong plus.

Responsibilities

• Design precise, task-specific grading criteria for real-world brand design deliverables.
• Score AI-generated and human work samples against criteria with detailed written justifications.
• Apply evidence-based judgment to ensure scores are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and iterate quickly.

Skills

Brand design

Graphic design

Written communication

Attention to detail

AI training experience

Job description

Mercor partners with a leading AI research organization to hire experienced brand designers who will define grading criteria for real-world brand and design work. You will score both AI-generated and human samples, providing detailed written justifications for every score.

The role emphasizes reproducible, defensible judgments, iterative work with senior reviewers, and clear communication about why each piece meets or misses the bar.