Nonprofit Program Evaluator - Expert

mercor; United States; Remote; USD 110,000 - 165,000; Part time

Job summary

Mercor connects elite creative and technical talent with leading AI research labs. We seek an evaluator to review AI outputs against domain rubrics and provide detailed feedback. This is a remote contract role requiring strong English communication and deep subject-matter knowledge.

You will grade artifacts, identify errors, and contribute to improvements in model performance while working independently to meet tight deadlines.

Qualifications

• 5+ years of relevant experience in nonprofit/philanthropy/community programs.
• Native or professional fluency in English.
• Proficiency in Microsoft Office and Google Workspace, especially Slides.
• Advanced degree (Master's or higher) preferred.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors.
• Provide clear, structured written feedback.
• Apply deep subject-matter expertise to grade outputs.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

Nonprofit/philanthropy experience

English fluency

Education

Master's degree

Tools

Microsoft Office

Google Workspace

Google Slides

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Nonprofit / philanthropy / community programs. Evaluator Type: Contract. Compensation: $80–$120/hour. Location: Remote.

Role Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors.
• Provide clear, structured written feedback.
• Apply deep subject-matter expertise to grade outputs.
• Work independently and asynchronously to meet deadlines while improving AI model performance .

Must-Have Qualifications

• 5+ years of relevant professional experience in Nonprofit / philanthropy / community programs.
• Native or professional fluency in English .
• Highly proficient in Microsoft Office and Google Workspace , especially Slides .

Preferred Qualifications

• Advanced degree ( Master's or higher) from a reputable institution.