AI Quality Evaluator — Customer Success (Remote, Contract)

Mercor; San Francisco (CA); Hybrid; GBP 83,000 - 124,000; Part time

Job summary

Mercor is seeking a Customer Success / Support Operations Evaluator for a remote contract role. You will evaluate AI-generated artifacts against domain rubrics, identify issues, and provide structured feedback to help improve AI model performance.

The ideal candidate has 5+ years in customer success or support operations, English fluency, and strong experience with MS Office and Google Workspace (including Slides). A Master’s degree is preferred.

Qualifications

• 5+ years of relevant professional experience in Customer success / support operations.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors.
• Provide clear, structured written feedback.
• Apply deep subject-matter expertise to grade outputs.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

Customer success

English fluency

MS Office

Google Workspace

Slides

Education

Master's degree

Tools

MS Office

Google Workspace

Slides

Job description

Mercor is seeking a Customer Success / Support Operations Evaluator for a remote contract role. You will evaluate AI-generated artifacts against domain rubrics, identify issues, and provide structured feedback to help improve AI model performance.

The ideal candidate has 5+ years in customer success or support operations, English fluency, and strong experience with MS Office and Google Workspace (including Slides). A Master’s degree is preferred.