Marketing Specialist - Fully Remote | Upto $80/hr

mercor; San Francisco (CA); Hybrid; AUD 118,000 - 158,000; Full time

Job summary

Mercor is seeking a Business Domain Expert - AI Model Evaluation Pilot to work remotely. This role focuses on evaluating AI model outputs across admin, marketing, HR and accounting domains, with real tasks and evidence-based judgments.

As an hourly contractor, you will sign an NDA, complete a domain-specific task, score five model outputs, provide rationales, and deliver structured feedback within a tight turnaround.

Qualifications

• 5+ years of hands-on professional experience in Admin, Marketing, Human Resources, or Accounting.
• Currently or recently practicing to judge work as a working professional would.
• Ability to write a clear, specific, evidence-grounded rationale for a judgment.
• Reliable within a short turnaround window.

Responsibilities

• Sign an NDA before receiving any materials.
• Solve one realistic, domain-specific task using the source files provided.
• Review five model-generated outputs for that task. Rank them 1-5 with no ties, score each 0-100, and write evidence-based rationales citing specific parts of the output.
• Provide structured feedback on the task itself and on the study design.
• Work independently to complete the task within a short turnaround window.

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position

Business Domain Expert - AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting)

Contract Type

Contract

Compensation

$60-$80/hour

Location

Remote

Responsibilities

• Sign an NDA before receiving any materials.
• Solve one realistic, domain-specific task using the source files provided.
• Review five model-generated outputs for that task. Rank them 1-5 with no ties, score each 0-100, and write evidence-based rationales citing specific parts of the output.
• Provide structured feedback on the task itself and on the study design.
• Work independently to complete the task within a short turnaround window.

Qualifications Must-Have

• 5+ years of hands-on professional experience in Admin , Marketing , Human Resources , or Accounting .
• Currently or recently practicing to judge work as a working professional would.
• Ability to write a clear, specific, evidence-grounded rationale for a judgment.
• Reliable within a short turnaround window.

Compensation & Legal

• Hourly contractor