AI Evaluator - Software Expert

Mercor; Greater London; Remote; GBP 2,066,000 - 3,444,000; Part time

Job summary

Mercor is seeking expert Evaluators in Software / AI / IT / data to review AI-generated outputs for accuracy, domain quality, and presentation. This is a remote, hourly engagement.

You will apply deep subject-matter expertise to grade documents, spreadsheets, and slide decks, identify errors, and provide clear, structured written feedback to help improve AI outputs.

Qualifications

• 5+ years of relevant professional experience in Software/AI/IT/data.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors.
• Provide clear, structured written feedback.

Skills

5+ years experience

Fluent English

Microsoft Office

Google Slides

Education

Advanced degree (Master's or higher)

Job description

About the role

We are hiring expert Evaluators in Software / AI / IT / data to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs.

This is a remote, hourly engagement.

Requirements (must have)

1. 5+ years of relevant professional experience in Software / AI / IT / data.

2. Native or professional fluency in English.

3. Highly proficient in Microsoft Office and Google Workspace, especially Slides (Google Slides / PowerPoint).

Preferred (nice to have)

• Advanced degree (Master's or higher) from a reputable institution.

What you’ll do

• Evaluate AI-generated artifacts against domain-specific quality rubrics.

• Identify factual, aesthetic, and presentation errors.

• Provide clear, structured written feedback.