Remote AI Quality Evaluator — Customer Success Ops

Mercor; San Francisco (CA); Hybrid; GBP 82,000 - 123,000; Part time

Job summary

Mercor is seeking a Customer Success Operations Evaluator for remote work. This contract role pays $80–$120 per hour and focuses on evaluating AI-generated artifacts, identifying issues, and providing structured feedback to improve model performance.

The role requires at least 5 years in customer success or support operations, native-level English, and strong skills in Microsoft Office and Google Workspace (especially Slides). Collaboration with SMEs is expected to ensure dataset relevance.

Qualifications

• 5+ years of relevant professional experience in Customer success / support operations.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in outputs.
• Provide clear, structured written feedback to improve AI model performance.
• Work independently and asynchronously to meet deadlines while ensuring high-quality assessments.
• Collaborate with subject matter experts to ensure consistency and relevance across datasets.

Skills

5+ years in Customer success / support

English fluency

Microsoft Office

Google Workspace

Slides proficiency

Education

Master's degree or higher

Tools

Microsoft Office

Google Workspace

Slides

Job description

Mercor is seeking a Customer Success Operations Evaluator for remote work. This contract role pays $80–$120 per hour and focuses on evaluating AI-generated artifacts, identifying issues, and providing structured feedback to improve model performance.

The role requires at least 5 years in customer success or support operations, native-level English, and strong skills in Microsoft Office and Google Workspace (especially Slides). Collaboration with SMEs is expected to ensure dataset relevance.