Marketing Evaluation Architect

Mercor; Paris; On-site; EUR 60,000 - 90,000; Full time

Job summary

Mercor partners with a leading AI research organization to recruit experienced marketing professionals for a project that evaluates how well AI systems perform real-world marketing work. You will define what excellent work looks like by designing task-specific grading criteria and scoring finished samples with rigorous, well-reasoned written justifications.

You will apply consistent, evidence-based judgment to ensure scores are reproducible and defendable, iterating with senior reviewers to

Qualifications

• 5+ years of professional experience in marketing or advertising.
• Background as creative director, account lead, or brand strategist at top-tier agencies or consumer brands.
• Fluency in the day-to-day craft: writing and evaluating creative briefs, campaign development across channels, brand positioning and messaging.
• Exceptionally strong written communication; ability to explain why a piece of work does or does not meet the bar.
• Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
• Prior experience with AI training, evaluation, or human-data projects is a strong plus.
• No specialized media-planning or measurement background is required for this role.

Responsibilities

• Design precise, task-specific grading criteria for real-world marketing deliverables.
• Score AI-generated and human work samples against those criteria, with detailed written justifications for every score.
• Apply consistent, evidence-based judgment so that scores are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and iterate quickly on your work.

Skills

Marketing experience

Creative director

Brand strategist

Written communication

AI evaluation

Job description

Mercor partners with a leading AI research organization to recruit experienced marketing professionals for a project that evaluates how well AI systems perform real-world marketing work. You will define what excellent work looks like by designing task-specific grading criteria and scoring finished samples with rigorous, well-reasoned written justifications.

You will apply consistent, evidence-based judgment to ensure scores are reproducible and defendable, iterating with senior reviewers to