AI Evaluator - Software Expert

Mercor; New York (NY); Remote; USD 34,000 - 55,000; Full time

Job summary

Mercor is seeking expert Evaluators to review AI-generated outputs (docs, spreadsheets, slides) for accuracy and domain quality. This is a remote, hourly engagement.

You will apply deep subject-matter expertise to grade outputs, provide structured written feedback, and help ensure high-quality presentations and documents.

Qualifications

• 5+ years of relevant professional experience in Software / AI / IT / data.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors.
• Provide clear, structured written feedback.

Skills

English fluency

Software/AI/IT/data experience

Office & Slides proficiency

Remote evaluation experience

Education

Advanced degree (Master's or higher)

Tools

Microsoft Office

Google Workspace

Slides

Job description

About the role

We are hiring expert Evaluators in Software / AI / IT / data to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs.

This is a remote, hourly engagement.

Requirements (must have)

1. 5+ years of relevant professional experience in Software / AI / IT / data.

2. Native or professional fluency in English.

3. Highly proficient in Microsoft Office and Google Workspace, especially Slides (Google Slides / PowerPoint).

Preferred (nice to have)

• Advanced degree (Master's or higher) from a reputable institution.

What you’ll do

• Evaluate AI-generated artifacts against domain-specific quality rubrics.

• Identify factual, aesthetic, and presentation errors.

• Provide clear, structured written feedback.