Remote AI Quality Evaluator & Feedback Specialist

mercor; San Francisco (CA); Hybrid; AUD 158,000 - 237,000; Full time

Job summary

Mercor is seeking a Software / AI / IT / data Evaluator for contract work. The role is remote and pays $80–$120 per hour. You will assess AI outputs against domain rubrics, identify errors, and provide structured feedback to improve quality.

Requirements include 5+ years in Software/AI/IT/data, native or professional English, and strong MS Office and Google Workspace skills, especially Slides. A Master's degree or higher is preferred.

Qualifications

• 5+ years of relevant professional experience in Software/AI/IT/data.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in outputs.
• Provide clear, structured written feedback to improve quality.
• Work independently and asynchronously to meet deadlines.
• Utilize expertise in Microsoft Office and Google Workspace, especially Slides.

Skills

English fluency

Independent worker

Education

Master's degree or higher

Tools

Microsoft Office

Google Workspace

Slides

Job description

Mercor is seeking a Software / AI / IT / data Evaluator for contract work. The role is remote and pays $80–$120 per hour. You will assess AI outputs against domain rubrics, identify errors, and provide structured feedback to improve quality.

Requirements include 5+ years in Software/AI/IT/data, native or professional English, and strong MS Office and Google Workspace skills, especially Slides. A Master's degree or higher is preferred.