Remote AI Quality Evaluator for Nonprofit Programs (Contract)

mercor; United States; Remote; USD 110,000 - 165,000; Part time

Job summary

Mercor connects elite creative and technical talent with leading AI research labs. We seek an evaluator to review AI outputs against domain rubrics and provide detailed feedback. This is a remote contract role requiring strong English communication and deep subject-matter knowledge.

You will grade artifacts, identify errors, and contribute to improvements in model performance while working independently to meet tight deadlines.

Qualifications

• 5+ years of relevant experience in nonprofit/philanthropy/community programs.
• Native or professional fluency in English.
• Proficiency in Microsoft Office and Google Workspace, especially Slides.
• Advanced degree (Master's or higher) preferred.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors.
• Provide clear, structured written feedback.
• Apply deep subject-matter expertise to grade outputs.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

Nonprofit/philanthropy experience

English fluency

Education

Master's degree

Tools

Microsoft Office

Google Workspace

Google Slides

Job description

Mercor connects elite creative and technical talent with leading AI research labs. We seek an evaluator to review AI outputs against domain rubrics and provide detailed feedback. This is a remote contract role requiring strong English communication and deep subject-matter knowledge.

You will grade artifacts, identify errors, and contribute to improvements in model performance while working independently to meet tight deadlines.