Remote Experiment Readiness Expert

Mercor; Sydney; Remote; AUD 110,000 - 165,000; Full time

Job summary

Mercor, a leader in connecting elite creative and technical talent with AI research labs, is seeking a Contract Product launch / experiment readiness Evaluator. The role is remote, paying $80–$120/hour, and requires 5+ years in product launch/experiment readiness with native/professional English and proficiency in Microsoft Office and Google Workspace, especially Slides.

The ideal candidate will evaluate AI-generated artifacts, identify errors in documents, spreadsheets, and slide decks, and

Qualifications

• 5+ years of relevant professional experience in Product launch / experiment readiness.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Provide clear, structured written feedback to improve AI model outputs.
• Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
• Work independently and asynchronously to meet deadlines and ensure high-quality evaluations.

Skills

Product launch experience

English fluency

Independent work

Education

Master's degree or higher

Tools

Microsoft Office

Google Workspace

Slides

Job description

Mercor, a leader in connecting elite creative and technical talent with AI research labs, is seeking a Contract Product launch / experiment readiness Evaluator. The role is remote, paying $80–$120/hour, and requires 5+ years in product launch/experiment readiness with native/professional English and proficiency in Microsoft Office and Google Workspace, especially Slides.

The ideal candidate will evaluate AI-generated artifacts, identify errors in documents, spreadsheets, and slide decks, and