Brand Strategist – AI Evaluation & Quality Scoring

Obsidian; San Francisco (CA); Remote; USD 110,000 - 170,000; Full time

Job summary

Mercor partners with a leading AI research organization to hire seasoned marketing professionals who will define what excellent work looks like in real-world campaigns. You will design task-specific grading criteria and evaluate samples with rigorous, well-reasoned written justifications.

You will score AI-generated and human work against briefs, ensure reproducible judgments, and incorporate senior reviewer feedback to calibrate the rubric.

Qualifications

• 5+ years of professional experience in marketing or advertising.
• Background as a creative director, account lead, or brand strategist at top-tier global creative agencies, or in senior brand marketing roles at leading consumer companies.
• Deep fluency in the day-to-day craft: writing and evaluating creative briefs, campaign development across channels, brand positioning and messaging, and judging creative work against a brief and a business objective.
• Exceptionally strong written communication, with the ability to explain exactly why a piece of work does or does not meet the bar.
• Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
• Prior experience with AI training, evaluation, or human-data projects is a strong plus.
• No specialized media-planning or measurement background is required for this role

Responsibilities

• Design precise, task-specific grading criteria for real-world marketing deliverables (creative briefs, campaign concepts and decks, brand positioning and messaging frameworks, ad copy and scripts, integrated campaign plans, client-ready presentations).
• Score AI-generated and human work samples against those criteria, with detailed written justifications for every score
• Apply consistent, evidence-based judgment so that scores are reproducible and defensible
• Incorporate structured feedback from senior reviewers and iterate quickly on your work

Skills

Marketing leadership

Creative direction

Brand strategy

Excellent writing

Job description

Mercor partners with a leading AI research organization to hire seasoned marketing professionals who will define what excellent work looks like in real-world campaigns. You will design task-specific grading criteria and evaluate samples with rigorous, well-reasoned written justifications.

You will score AI-generated and human work against briefs, ensure reproducible judgments, and incorporate senior reviewer feedback to calibrate the rubric.