Remote Philanthropy & AI Quality Evaluator

Mercor; Sydney; Remote; AUD 159,000 - 239,000; Full time

Job summary

Mercor is seeking an Evaluator for nonprofit/philanthropy/community programs to work remotely on a contract basis. You will assess AI-generated artifacts against quality rubrics and provide clear written feedback to improve AI model performance.

The requirements include 5+ years in nonprofit work, native or professional English, and high proficiency with Microsoft Office and Google Workspace, especially Slides; a Master’s degree is preferred.

Qualifications

• 5+ years of relevant professional experience in nonprofit/philanthropy/community programs.
• Native or professional fluency in English.
• Proficiency with Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors.
• Provide clear, structured written feedback.
• Apply deep subject-matter expertise to grade outputs.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

English fluency

Education

Master's degree or higher

Tools

Microsoft Office

Google Workspace

Slides

Job description

Mercor is seeking an Evaluator for nonprofit/philanthropy/community programs to work remotely on a contract basis. You will assess AI-generated artifacts against quality rubrics and provide clear written feedback to improve AI model performance.

The requirements include 5+ years in nonprofit work, native or professional English, and high proficiency with Microsoft Office and Google Workspace, especially Slides; a Master’s degree is preferred.