Brand Design Evaluation Expert — AI Quality Judge

Mercor; Boston (MA); On-site; USD 70,000 - 100,000; Full time

Job summary

Mercor, in Boston, seeks experienced brand designers to shape evaluation criteria for real-world branding work and to score AI-generated and human samples against those criteria with rigorous written justifications.

Ideal candidates bring agency-level craft in typography, layout, identity systems, and brand messaging, plus exceptional written communication to articulate critiques and defend judgments.

Qualifications

• 5+ years of professional experience in brand, visual, or graphic design.
• Agency experience at world-class independent firms (e.g., Pentagram, Wolff Olins, Landor, Collins, IDEO) — not in-house.
• Experience in core brand disciplines: Creative Director, Brand Designer, Web Designer (UI/UX), or Graphic Designer.
• Deep fluency in typography, layout, color, visual hierarchy, identity systems, and critique articulation.
• Exceptional written communication, able to explain why a piece meets or misses the bar.
• Detail-oriented with comfort calibrating judgment across peers.
• Copywriting and brand messaging experience — audience research, positioning — a strong plus.
• Prior experience with AI training/evaluation or human-data projects is a strong plus.

Responsibilities

• Design precise, task-specific grading criteria for real-world brand design deliverables.
• Score AI-generated and human work samples against criteria with detailed written justifications.
• Apply consistent, evidence-based judgment for reproducible and defensible scores.
• Incorporate structured feedback from senior reviewers and iterate quickly on work.

Skills

Brand design

Typography

Layout

Brand identity

Written communication

Detail-oriented

Copywriting

Critical evaluation

Job description

Mercor, in Boston, seeks experienced brand designers to shape evaluation criteria for real-world branding work and to score AI-generated and human samples against those criteria with rigorous written justifications.

Ideal candidates bring agency-level craft in typography, layout, identity systems, and brand messaging, plus exceptional written communication to articulate critiques and defend judgments.