Brand Strategy Evaluator: Grading AI-Generated Work

Obsidian; New York (NY); Remote; USD 90,000 - 130,000; Full time

Job summary

Mercor is seeking experienced marketing professionals to join a project that defines what excellent AI-assisted marketing work looks like. You will design task-specific grading criteria and rigorously score samples with detailed written justifications.

Applicants should have 5+ years in marketing or advertising, with strong writing, brand strategy, and familiarity with AI training or evaluation. This is a highly collaborative, fast-moving effort focused on quality and defensible scoring.

Qualifications

• 5+ years of experience in marketing or advertising.
• Background as creative director, account lead, or brand strategist.
• Fluency in crafting briefs, campaigns, and brand messaging.
• Exceptional written communication to justify scores.
• Detail-oriented with ability to calibrate judgments.
• Prior AI training/evaluation experience is a plus.

Responsibilities

• Design precise, task-specific grading criteria for real-world marketing deliverables.
• Score AI-generated and human work samples with detailed written justifications.
• Apply evidence-based judgment to ensure scores are reproducible.
• Incorporate senior reviewer feedback and iterate quickly.

Skills

Marketing

Creative Direction

Brand Strategy

Exceptional Writing

AI Evaluation

Quality Judgement

Job description

Mercor is seeking experienced marketing professionals to join a project that defines what excellent AI-assisted marketing work looks like. You will design task-specific grading criteria and rigorously score samples with detailed written justifications.

Applicants should have 5+ years in marketing or advertising, with strong writing, brand strategy, and familiarity with AI training or evaluation. This is a highly collaborative, fast-moving effort focused on quality and defensible scoring.