Customer Success Operations Evaluator

Mercor

Sydney

Remote

AUD 163,000 - 244,000

Part time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Mercor is seeking a Customer Success Operations Evaluator to work remotely. The role involves evaluating AI-generated artifacts against quality rubrics and identifying errors to improve model performance.

You will provide structured feedback and collaborate with SMEs, working independently to meet deadlines. Requirements include 5+ years in customer success or support operations, native or professional English, and strong proficiency in Microsoft Office and Google Workspace (Slides).

Qualifications

  • 5+ years of professional experience in Customer success / support operations.
  • Native or professional fluency in English.
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in outputs.
  • Provide clear, structured written feedback to improve AI model performance.
  • Work independently and asynchronously to meet deadlines while ensuring high-quality assessments.
  • Collaborate with subject matter experts to ensure consistency and relevance across datasets.

Skills

English fluency
Microsoft Office
Google Workspace
Slides

Education

Master's degree or higher

Tools

None

Job description

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Customer success / support operations Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in outputs.
  • Provide clear, structured written feedback to improve AI model performance.
  • Work independently and asynchronously to meet deadlines while ensuring high-quality assessments.
  • Collaborate with subject matter experts to ensure consistency and relevance across datasets.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Customer success / support operations.
  • Native or professional fluency in English.
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

Customer Success Operations Evaluator • Sydney, New South Wales, Australia

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Contract: AI Quality Assurance & Customer Success Evaluator
Remote Contract: AI Quality Assurance & Customer Success Evaluator

Mercor • Sydney

Remote
AUD 163,000 - 244,000
Program Management Evaluator - Expert
Program Management Evaluator - Expert

Mercor • Sydney

Remote
AUD 110,000 - 165,000
Product Launch Expert - Evaluator
Product Launch Expert - Evaluator

Mercor • Sydney

Remote
AUD 157,000 - 236,000
L&D Evaluator - Training Expert
L&D Evaluator - Training Expert

Mercor • Sydney

Remote
AUD 163,000 - 244,000
Audit Support Specialist - Fully Remote | Upto $120/Hr
Audit Support Specialist - Fully Remote | Upto $120/Hr

Mercor • Sydney

Remote
AUD 157,000 - 235,000
Recruiting Evaluator - Fully Remote | Upto $120/Hr
Recruiting Evaluator - Fully Remote | Upto $120/Hr

Mercor • Sydney

Remote
AUD 157,000 - 235,000
Experiment Readiness Specialist - Remote | Upto $120/Hr
Experiment Readiness Specialist - Remote | Upto $120/Hr

Mercor • Sydney

Remote
AUD 110,000 - 165,000
Personal Finance Expert Evaluator
Personal Finance Expert Evaluator

Mercor • Sydney

Remote
AUD 163,000 - 244,000
Real Estate Evaluator - Expert
Real Estate Evaluator - Expert

Mercor • Sydney

Remote
AUD 159,000 - 239,000
Quantitative Readouts Specialist - Remote | Upto $120/Hr
Quantitative Readouts Specialist - Remote | Upto $120/Hr

Mercor • Sydney

Remote
AUD 157,000 - 235,000
Top locations