Remote Contract: AI Quality Assurance & Customer Success Evaluator

Mercor

Sydney

Remote

AUD 163,000 - 244,000

Part time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mercor is seeking a Customer Success Operations Evaluator to work remotely. The role involves evaluating AI-generated artifacts against quality rubrics and identifying errors to improve model performance.

You will provide structured feedback and collaborate with SMEs, working independently to meet deadlines. Requirements include 5+ years in customer success or support operations, native or professional English, and strong proficiency in Microsoft Office and Google Workspace (Slides).

Qualifications

  • 5+ years of professional experience in Customer success / support operations.
  • Native or professional fluency in English.
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in outputs.
  • Provide clear, structured written feedback to improve AI model performance.
  • Work independently and asynchronously to meet deadlines while ensuring high-quality assessments.
  • Collaborate with subject matter experts to ensure consistency and relevance across datasets.

Skills

English fluency
Microsoft Office
Google Workspace
Slides

Education

Master's degree or higher

Tools

None

Job description

Mercor is seeking a Customer Success Operations Evaluator to work remotely. The role involves evaluating AI-generated artifacts against quality rubrics and identifying errors to improve model performance.

You will provide structured feedback and collaborate with SMEs, working independently to meet deadlines. Requirements include 5+ years in customer success or support operations, native or professional English, and strong proficiency in Microsoft Office and Google Workspace (Slides).

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Customer Success Operations Evaluator
Customer Success Operations Evaluator

Mercor • Sydney

Remote
AUD 163,000 - 244,000
Remote AI Quality & Program Evaluation Specialist
Remote AI Quality & Program Evaluation Specialist

Mercor • Sydney

Remote
AUD 110,000 - 165,000
Remote Culture & AI Quality Assessor
Remote Culture & AI Quality Assessor

Mercor • Sydney

Remote
AUD 163,000 - 244,000
Remote Legal Compliance Evaluator (Contract)
Remote Legal Compliance Evaluator (Contract)

Mercor • Sydney

Remote
AUD 157,000 - 235,000
Remote Recruiting Evaluator: AI Quality & Feedback
Remote Recruiting Evaluator: AI Quality & Feedback

Mercor • Sydney

Remote
AUD 157,000 - 235,000
Remote Legal Contracts & AI Diligence Evaluator
Remote Legal Contracts & AI Diligence Evaluator

Mercor • Sydney

Remote
AUD 163,000 - 244,000
Remote Contract: Experiment Readiness Evaluator
Remote Contract: Experiment Readiness Evaluator

Mercor • Sydney

Remote
AUD 110,000 - 165,000
Remote Audit Support Specialist - AI Data QA
Remote Audit Support Specialist - AI Data QA

Mercor • Sydney

Remote
AUD 157,000 - 235,000
Remote Product Roadmap Evaluator for AI Quality
Remote Product Roadmap Evaluator for AI Quality

Mercor • Sydney

Remote
AUD 162,000 - 243,000
AI Product Manager & PRD Evaluator (Remote, Contract)
AI Product Manager & PRD Evaluator (Remote, Contract)

Mercor • Sydney

Remote
AUD 162,000 - 243,000
Top locations