Remote AI Quality & Program Evaluation Specialist

Mercor

Sydney

Remote

AUD 110,000 - 165,000

Part time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mercor is seeking a Program management / implementation planning Evaluator for a remote contract role. The candidate will review AI-generated artifacts, identify errors, and provide structured feedback. Collaboration with experts and independent, asynchronous work are required.

Must have 5+ years in PM/implementation planning, native or professional English, and strong proficiency in Microsoft Office and Google Workspace, especially Slides; advanced degree preferred.

Qualifications

  • 5+ years of relevant professional experience in Program management / implementation planning.
  • Native or professional fluency in English.
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in AI-generated work products.
  • Provide clear, structured written feedback to improve AI model outputs.
  • Collaborate with subject matter experts to ensure consistency and quality.
  • Work independently and asynchronously to meet deadlines.

Skills

English fluency
Program management

Education

Advanced degree

Tools

Microsoft Office
Google Workspace
Slides

Job description

Mercor is seeking a Program management / implementation planning Evaluator for a remote contract role. The candidate will review AI-generated artifacts, identify errors, and provide structured feedback. Collaboration with experts and independent, asynchronous work are required.

Must have 5+ years in PM/implementation planning, native or professional English, and strong proficiency in Microsoft Office and Google Workspace, especially Slides; advanced degree preferred.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Public Sector AI Quality Evaluator (Remote)
Public Sector AI Quality Evaluator (Remote)

Mercor • Sydney

Remote
AUD 110,000 - 165,000
Program Management Evaluator - Expert
Program Management Evaluator - Expert

Mercor • Sydney

Remote
AUD 110,000 - 165,000
Remote Contract: AI Quality Assurance & Customer Success Evaluator
Remote Contract: AI Quality Assurance & Customer Success Evaluator

Mercor • Sydney

Remote
AUD 163,000 - 244,000
Remote Product Roadmap Evaluator for AI Quality
Remote Product Roadmap Evaluator for AI Quality

Mercor • Sydney

Remote
AUD 162,000 - 243,000
Remote Recruiting Evaluator: AI Quality & Feedback
Remote Recruiting Evaluator: AI Quality & Feedback

Mercor • Sydney

Remote
AUD 157,000 - 235,000
Remote AI Content Quality Reviewer
Remote AI Content Quality Reviewer

Mercor • Sydney

Remote
AUD 96,000 - 117,000
AI Product Manager & PRD Evaluator (Remote, Contract)
AI Product Manager & PRD Evaluator (Remote, Contract)

Mercor • Sydney

Remote
AUD 162,000 - 243,000
Remote Public Health AI Evaluation Specialist (Contract)
Remote Public Health AI Evaluation Specialist (Contract)

Mercor • Sydney

Remote
AUD 163,000 - 244,000
Remote Legal Compliance Evaluator (Contract)
Remote Legal Compliance Evaluator (Contract)

Mercor • Sydney

Remote
AUD 157,000 - 235,000
Remote Biomedical AI Evaluator (Contract)
Remote Biomedical AI Evaluator (Contract)

Mercor • Sydney

Remote
AUD 163,000 - 244,000
Top locations