Remote AI Artifact Quality Evaluator

mercor; Canada; Remote; CAD 152,000 - 228,000; Full time

Job summary

Mercor is seeking an experienced evaluator for a remote contract role to assess AI-generated artifacts against quality rubrics and provide clear feedback. You will identify factual, aesthetic, and presentation issues across documents, spreadsheets, and slides, applying domain expertise to grade outputs and improve AI model performance.

Fluent English and 5+ years of experience are required. The position offers a remote arrangement with flexible hours and independent work to meet deadlines in a

Qualifications

• 5+ years of professional experience in user/customer research and feedback synthesis.
• Native or professional fluency in English.
• Proficiency in Microsoft Office and Google Workspace, especially Slides.
• Advanced degree (Master's or higher).

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Provide clear, structured written feedback to enhance AI work products.
• Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
• Work independently and asynchronously to meet deadlines and improve AI model performance.

Skills

User research

Feedback synthesis

English fluency

Education

Master's degree

Tools

Microsoft Office

Google Workspace

Slides

Job description

Mercor is seeking an experienced evaluator for a remote contract role to assess AI-generated artifacts against quality rubrics and provide clear feedback. You will identify factual, aesthetic, and presentation issues across documents, spreadsheets, and slides, applying domain expertise to grade outputs and improve AI model performance.

Fluent English and 5+ years of experience are required. The position offers a remote arrangement with flexible hours and independent work to meet deadlines in a