AI Evaluator & Quality Reviewer (Remote, Hourly)

Mercor; Sydney; On-site; AUD 55,000 - 103,000; Full time

Job summary

Mercor is seeking expert Evaluators in Software / AI / IT / data to review AI-generated artifacts for accuracy and quality. This remote, hourly engagement requires deep subject-matter expertise to grade outputs.

You will evaluate artifacts against domain rubrics, identify factual, aesthetic, and presentation errors, and provide clear, structured written feedback. Fluency in English and proficiency with Office/Slides are essential.

Qualifications

• 5+ years of relevant professional experience in Software/AI/IT/data.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides (Google Slides / PowerPoint).

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors.
• Provide clear, structured written feedback.

Skills

Experience in Software/AI/IT/data

English fluency

Microsoft Office & Google Slides/Power

Education

Master's degree (preferred)

Tools

Microsoft Office

Google Slides/PowerPoint

Job description

Mercor is seeking expert Evaluators in Software / AI / IT / data to review AI-generated artifacts for accuracy and quality. This remote, hourly engagement requires deep subject-matter expertise to grade outputs.

You will evaluate artifacts against domain rubrics, identify factual, aesthetic, and presentation errors, and provide clear, structured written feedback. Fluency in English and proficiency with Office/Slides are essential.