Remote Nonprofit Program Evaluator (Contract) — AI Quality

mercor; United States; Remote; USD 110,000 - 165,000; Full time

Job summary

Mercor connects elite creative and technical talent with leading AI research labs. Remote position for an Evaluator to assess AI-generated artifacts using domain rubrics, identify errors, and deliver structured feedback to help improve model performance.

The role requires 5+ years in nonprofit/philanthropy/context and fluency in English, with strong MS Office and Google Workspace skills. This contract-based opportunity emphasizes independent, deadline-driven work.

Qualifications

• 5+ years of relevant professional experience in Nonprofit / philanthropy / community programs.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors.
• Provide clear, structured written feedback.
• Apply deep subject-matter expertise to grade outputs.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

English fluency

Nonprofit/philanthropy experience

Education

Master's degree or higher

Tools

Microsoft Office

Google Workspace

Slides

Job description

Mercor connects elite creative and technical talent with leading AI research labs. Remote position for an Evaluator to assess AI-generated artifacts using domain rubrics, identify errors, and deliver structured feedback to help improve model performance.

The role requires 5+ years in nonprofit/philanthropy/context and fluency in English, with strong MS Office and Google Workspace skills. This contract-based opportunity emphasizes independent, deadline-driven work.