Design Evaluation Expert - Graphic - AI Trainer

Mercor; Boston (MA); On-site; USD 70,000 - 100,000; Full time

Job summary

Mercor, in Boston, seeks experienced brand designers to shape evaluation criteria for real-world branding work and to score AI-generated and human samples against those criteria with rigorous written justifications.

Ideal candidates bring agency-level craft in typography, layout, identity systems, and brand messaging, plus exceptional written communication to articulate critiques and defend judgments.

Qualifications

• 5+ years of professional experience in brand, visual, or graphic design.
• Agency experience at world-class independent firms (e.g., Pentagram, Wolff Olins, Landor, Collins, IDEO) — not in-house.
• Experience in core brand disciplines: Creative Director, Brand Designer, Web Designer (UI/UX), or Graphic Designer.
• Deep fluency in typography, layout, color, visual hierarchy, identity systems, and critique articulation.
• Exceptional written communication, able to explain why a piece meets or misses the bar.
• Detail-oriented with comfort calibrating judgment across peers.
• Copywriting and brand messaging experience — audience research, positioning — a strong plus.
• Prior experience with AI training/evaluation or human-data projects is a strong plus.

Responsibilities

• Design precise, task-specific grading criteria for real-world brand design deliverables.
• Score AI-generated and human work samples against criteria with detailed written justifications.
• Apply consistent, evidence-based judgment for reproducible and defensible scores.
• Incorporate structured feedback from senior reviewers and iterate quickly on work.

Skills

Brand design

Typography

Layout

Brand identity

Written communication

Detail-oriented

Copywriting

Critical evaluation

Job description

1. Role Overview

Mercor is partnering with a leading AI research organization to engage experienced brand designers for a project focused on evaluating how well AI systems perform real-world brand and design work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications.

2. Key Responsibilities

• Design precise, task-specific grading criteria for real-world brand design deliverables (brand identity systems and guidelines, logos and visual identity, campaign and marketing visuals, packaging concepts, presentation and layout design, digital and social assets, and brand messaging and positioning)

• Score AI-generated and human work samples against those criteria, with detailed written justifications for every score

• Apply consistent, evidence-based judgment so that scores are reproducible and defensible

• Incorporate structured feedback from senior reviewers and iterate quickly on your work

3. Ideal Qualifications

• 5+ years of professional experience in brand, visual, or graphic design

• Background specifically at world-class independent brand and design agencies (e.g., Pentagram, Wolff Olins, Landor, Collins, IDEO) — agency experience, not in-house or enterprise design teams

• Experience in one of the core brand disciplines: Creative Director, Brand Designer (logo, visual identity, supporting graphics), Web Designer (UI/UX, web architecture), or Graphic Designer

• Deep fluency in the day-to-day craft: typography, layout and visual hierarchy, color, composition, logo and brand identity systems, and articulating critique the way a creative director would in a review

• Exceptionally strong written communication, with the ability to explain exactly why a piece of work does or does not meet the bar

• Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers

• Experience with copywriting and brand messaging — including audience research, competitor research, and positioning — is a strong plus

• Prior experience with AI training, evaluation, or human-data projects is a strong plus