Marketing Evaluation Architect

Mercor; New York (NY); On-site; USD 120,000 - 180,000; Full time

Job summary

Mercor is partnering with a leading AI research organization to engage experienced marketing professionals for a project that defines how excellent work looks. You will design grading criteria, evaluate real-world marketing samples, and provide rigorous written justifications for each score.

Ideal candidates have 5+ years in marketing or advertising, with backgrounds as creative directors, brand strategists, or senior marketing leads at top agencies or major brands, and strong written

Qualifications

• 5+ years of marketing or advertising experience.
• Experience as creative director, account lead, or brand strategist at top agencies or leading consumer brands.
• Deep fluency in writing briefs, campaign development, brand messaging, and judging work to a brief and business objective.
• Exceptional written communication; ability to explain why a piece of work meets or misses the bar.
• Detail-oriented, consistent, and comfortable with peer review calibration.
• Prior experience with AI training, evaluation, or human-data projects is a strong plus.
• No specialized media-planning or measurement background required.

Responsibilities

• Design precise, task-specific grading criteria for real-world marketing deliverables (creative briefs, campaign concepts and decks, brand positioning and messaging frameworks, ad copy and scripts, integrated campaign plans, client-ready presentations).
• Score AI-generated and human work samples against those criteria, with detailed written justifications for every score.
• Apply consistent, evidence-based judgment so that scores are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and iterate quickly on your work.

Skills

Marketing leadership

Creative direction

Brand strategy

AI training evaluation

Written communication

Job description

Mercor is partnering with a leading AI research organization to engage experienced marketing professionals for a project that defines how excellent work looks. You will design grading criteria, evaluate real-world marketing samples, and provide rigorous written justifications for each score.

Ideal candidates have 5+ years in marketing or advertising, with backgrounds as creative directors, brand strategists, or senior marketing leads at top agencies or major brands, and strong written