AI Experiment Readiness Evaluator (Remote)

mercor; United Kingdom; Remote; GBP 83,000 - 125,000; Part time

Job summary

Mercor is seeking a remote, contract-based Evaluator for product launch and experiment readiness. You will assess AI-generated artifacts, identify errors in documents and slides, and deliver structured feedback to improve model outputs.

The role requires strong English fluency and collaboration across time zones, with a focus on independent, deadline-driven work. The ideal candidate has 5+ years in product launch or experiment readiness, plus advanced proficiency in MS Office and Google

Qualifications

• 5+ years of relevant professional experience in Product launch / experiment readiness.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Provide clear, structured written feedback to improve AI model outputs.
• Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
• Work independently and asynchronously to meet deadlines while ensuring domain quality.

Skills

Product launch

Experiment readiness

English fluency

MS Office

Google Workspace

Slides

Education

Master's degree

Job description

Mercor is seeking a remote, contract-based Evaluator for product launch and experiment readiness. You will assess AI-generated artifacts, identify errors in documents and slides, and deliver structured feedback to improve model outputs.

The role requires strong English fluency and collaboration across time zones, with a focus on independent, deadline-driven work. The ideal candidate has 5+ years in product launch or experiment readiness, plus advanced proficiency in MS Office and Google