Marketing Expert - Creative Director

Obsidian

New York (NY)

On-site

USD 90,000 - 150,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mercor is partnering with a leading AI research organization to design tasks and grade real-world marketing work. You will define what excellent work looks like, write criteria, and provide rigorous written justifications for scores.

Ideal candidates bring 5+ years in marketing or advertising, with experience as a creative director, account lead, or brand strategist at top agencies or leading consumer brands. Strong written communication is essential.

Qualifications

  • 5+ years of professional experience in marketing or advertising.
  • Background as a creative director, account lead, or brand strategist at top-tier agencies.
  • Deep fluency in crafting briefs, campaign development, and brand messaging.
  • Excellent written communication with ability to justify scores.
  • Detail-oriented with ability to calibrate judgments with peers.

Responsibilities

  • Design precise, task-specific grading criteria for real-world marketing deliverables.
  • Score AI-generated and human work samples against those criteria with written justifications.
  • Apply consistent, evidence-based judgment to ensure reproducible scores.
  • Incorporate structured feedback from senior reviewers and iterate quickly.

Skills

Marketing experience
Advertising background
Brand strategy
Creative brief writing
Written communication

Job description

1. Role Overview

Mercor is partnering with a leading AI research organization to engage experienced marketing professionals for a project focused on evaluating how well AI systems perform real-world marketing work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications.

2. Key Responsibilities
  • Design precise, task-specific grading criteria for real-world marketing deliverables (creative briefs, campaign concepts and decks, brand positioning and messaging frameworks, ad copy and scripts, integrated campaign plans, client-ready presentations)

  • Score AI-generated and human work samples against those criteria, with detailed written justifications for every score

  • Apply consistent, evidence-based judgment so that scores are reproducible and defensible

  • Incorporate structured feedback from senior reviewers and iterate quickly on your work

3. Ideal Qualifications
  • 5+ years of professional experience in marketing or advertising

  • Background as a creative director, account lead, or brand strategist at top-tier global creative agencies, or in senior brand marketing roles at leading consumer companies

  • Deep fluency in the day-to-day craft: writing and evaluating creative briefs, campaign development across channels, brand positioning and messaging, and judging creative work against a brief and a business objective

  • Exceptionally strong written communication, with the ability to explain exactly why a piece of work does or does not meet the bar

  • Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers

  • Prior experience with AI training, evaluation, or human-data projects is a strong plus

  • No specialized media-planning or measurement background is required for this role

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Marketing Expert - Creative Director
Marketing Expert - Creative Director

Mercor • New York (NY)

On-site
USD 120,000 - 180,000
Marketing Expert - Evaluation Specialist
Marketing Expert - Evaluation Specialist

Mercor • New York (NY)

On-site
USD 85,000 - 120,000
Senior Brand Strategist & AI Marketing Evaluator
Senior Brand Strategist & AI Marketing Evaluator

Mercor • San Francisco (CA)

Remote
USD 120,000 - 180,000
Marketing Evaluation Architect
Marketing Evaluation Architect

Mercor • New York (NY)

On-site
USD 120,000 - 180,000
Marketing Quality Architect for AI Evaluation
Marketing Quality Architect for AI Evaluation

Obsidian • New York (NY)

On-site
USD 90,000 - 150,000
Brand Strategy Evaluator & Grading Architect
Brand Strategy Evaluator & Grading Architect

Mercor • New York (NY)

Remote
USD 90,000 - 130,000
Marketing Quality Architect & Evaluator
Marketing Quality Architect & Evaluator

Mercor • New York (NY)

On-site
USD 85,000 - 120,000
Brand Strategy Evaluator: Grading AI-Generated Work
Brand Strategy Evaluator: Grading AI-Generated Work

Obsidian • New York (NY)

Remote
USD 90,000 - 130,000
Design Evaluation Expert - Graphic
Design Evaluation Expert - Graphic

Obsidian • New York (NY)

On-site
USD 90,000 - 130,000
Brand Strategist – AI Evaluation & Quality Scoring
Brand Strategist – AI Evaluation & Quality Scoring

Obsidian • San Francisco (CA)

Remote
USD 110,000 - 170,000