Marketing Expert - Evaluation Specialist

Mercor; Sydney; Remote; AUD 157,000 - 294,000; Part time

Job summary

Mercor is seeking a Marketing Expert on a remote, contract basis. The role involves designing criteria for marketing deliverables, scoring AI-generated and human samples, and applying evidence-based judgment to ensure reproducible, defensible results.

You will iteratively incorporate feedback from senior reviewers while working independently to meet deadlines and improve AI model performance. Ideal candidates have 5+ years in marketing or advertising, with a background as a creative director or

Qualifications

• 5+ years of professional experience in marketing or advertising.

Responsibilities

• Design precise, task-specific grading criteria for marketing deliverables.
• Score AI-generated and human work samples with detailed justifications.
• Apply evidence-based judgment to ensure scores are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and iterate quickly on your work.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

5+ years exp marketing

Creative director

Brand strategist

Strong writing

Written comms

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Marketing Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote

Role Responsibilities

• Design precise, task-specific grading criteria for real-world marketing deliverables, including creative briefs, campaign concepts, and brand positioning frameworks.
• Score AI-generated and human work samples against criteria with detailed written justifications for every score.
• Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and iterate quickly on your work.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Qualifications

Must-Have

• 5+ years of professional experience in marketing or advertising.
• Background as a creative director, account lead, or brand strategist at top-tier global creative agencies, or in senior brand marketing roles at leading consumer companies.
• Deep fluency in writing and evaluating creative briefs, campaign development, brand positioning, and messaging.
• Exceptionally strong written communication skills.
• Detail-oriented and consistent.

Preferred

• Prior experience with AI training, evaluation, or human-data projects.