AI Marketing Quality Evaluator

Mercor; Greater London; Remote; GBP 60,000 - 90,000; Full time

Job summary

Mercor is partnering with a leading AI research organization to engage experienced marketing professionals to design task-specific grading criteria and to score real-world marketing deliverables, not to produce them. You will provide detailed written justifications for each score and ensure the judgments are reproducible and defensible, drawing on feedback from senior reviewers to iterate quickly.

The role focuses on evaluating creative briefs, campaign concepts, brand positioning, ad copy, and

Qualifications

• 5+ years of professional experience in marketing or advertising.
• Background as a creative director, account lead, or brand strategist at top-tier global agencies, or senior brand marketing roles.
• Strong written communication with the ability to explain exactly why a piece of work does or does not meet the bar.
• Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
• Prior experience with AI training, evaluation, or human-data projects is a strong plus.
• No specialized media-planning or measurement background is required for this role.

Responsibilities

• Design precise, task-specific grading criteria for real-world marketing deliverables (creative briefs, campaign concepts and decks, brand positioning and messaging frameworks, ad copy and scripts, integrated campaign plans, client-ready presentations)
• Score AI-generated and human work samples against those criteria, with detailed written justifications for every score
• Apply consistent, evidence-based judgment so that scores are reproducible and defensible
• Incorporate structured feedback from senior reviewers and iterate quickly on your work

Skills

Marketing experience

Creative direction

Brand strategy

Written communication

Attention to detail

AI training

Job description

Mercor is partnering with a leading AI research organization to engage experienced marketing professionals to design task-specific grading criteria and to score real-world marketing deliverables, not to produce them. You will provide detailed written justifications for each score and ensure the judgments are reproducible and defensible, drawing on feedback from senior reviewers to iterate quickly.

The role focuses on evaluating creative briefs, campaign concepts, brand positioning, ad copy, and