Remote SRE Incident & AI Quality Evaluator

Mercor; Sydney; On-site; AUD 83,000 - 124,000; Full time

Job summary

Mercor is seeking expert Evaluators in Incident management, reliability, and SRE to review AI-generated artifacts for accuracy and quality. You will apply deep subject-matter expertise to grade outputs, including documents, spreadsheets, and slide decks.

This is a remote, hourly engagement. The role requires 5+ years in the field, native or professional English, and strong proficiency with Microsoft Office and Google Workspace, especially Slides.

Qualifications

• 5+ years of relevant professional experience in Incident management / reliability / SRE.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides (Google Slides / PowerPoint).

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors.
• Provide clear, structured written feedback.

Skills

Incident management

Reliability engineering

SRE

English fluency

Education

Advanced degree

Tools

Microsoft Office

Google Workspace

Google Slides

PowerPoint

Job description

Mercor is seeking expert Evaluators in Incident management, reliability, and SRE to review AI-generated artifacts for accuracy and quality. You will apply deep subject-matter expertise to grade outputs, including documents, spreadsheets, and slide decks.

This is a remote, hourly engagement. The role requires 5+ years in the field, native or professional English, and strong proficiency with Microsoft Office and Google Workspace, especially Slides.