AI Output Quality Evaluator — Customer Success (Remote)

mercor; San Francisco (CA); Hybrid; AUD 158,000 - 237,000; Full time

Job summary

Mercor is hiring a contract Customer success / support operations Evaluator to assess AI-generated artifacts against domain-specific quality rubrics, identify errors in documents, spreadsheets, and slide decks, and provide structured feedback to improve AI outputs.

You will work independently and asynchronously with global teams, ensuring high-quality deliverables, collaborating to set clear expectations, and applying 5+ years in customer success or operations, plus fluency in English and

Qualifications

• 5+ years of relevant professional experience in Customer success / support operations.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Provide clear, structured written feedback to improve AI outputs.
• Collaborate with teams to ensure high-quality deliverables.
• Work independently and asynchronously to meet deadlines.

Skills

Customer success

Support operations

Communication

Education

Master's degree

Tools

Microsoft Office

Google Workspace

Google Slides

Job description

Mercor is hiring a contract Customer success / support operations Evaluator to assess AI-generated artifacts against domain-specific quality rubrics, identify errors in documents, spreadsheets, and slide decks, and provide structured feedback to improve AI outputs.

You will work independently and asynchronously with global teams, ensuring high-quality deliverables, collaborating to set clear expectations, and applying 5+ years in customer success or operations, plus fluency in English and