Remote AI Experiment Readiness Evaluator

Mercor; United Kingdom; Remote; GBP 82,000 - 123,000; Full time

Job summary

Mercor, a leading connector of AI talent, is hiring a Contract Product launch / experiment readiness Evaluator. This fully remote role offers $80–$120 per hour.

You will evaluate AI-generated artifacts against domain rubrics, identify factual and presentation errors in documents, spreadsheets and slide decks, and deliver clear, structured feedback to improve model outputs. 5+ years of experience in product launch required; native or professional English; strong proficiency with Microsoft Office

Qualifications

• 5+ years of relevant experience in product launch / experiment readiness.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Provide clear, structured written feedback to improve AI model outputs.
• Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
• Work independently and asynchronously to meet deadlines and ensure high-quality evaluations.

Skills

Product launch / experiment readiness

Fluent English

Education

Master's degree

Tools

Microsoft Office

Google Workspace

Slides

Job description

Mercor, a leading connector of AI talent, is hiring a Contract Product launch / experiment readiness Evaluator. This fully remote role offers $80–$120 per hour.

You will evaluate AI-generated artifacts against domain rubrics, identify factual and presentation errors in documents, spreadsheets and slide decks, and deliver clear, structured feedback to improve model outputs. 5+ years of experience in product launch required; native or professional English; strong proficiency with Microsoft Office