Nonprofit Evaluator - Program Specialist

mercor; San Francisco (CA); Hybrid; AUD 158,000 - 237,000; Part time

Job summary

Mercor is seeking an Evaluator to join our nonprofit/philanthropy program team. This remote, contract position focuses on evaluating AI-generated artifacts against domain rubrics, and providing clear feedback to improve model outputs.

You will identify factual, aesthetic, and presentation errors in documents and presentations, working independently to meet deadlines while applying deep subject-matter expertise to ensure rigor and accuracy.

Qualifications

• 5+ years of relevant professional experience in Nonprofit / philanthropy / community programs.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.
• Preferred Advanced degree ( Master’s or higher ) from a reputable institution.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Provide clear, structured written feedback to improve AI model outputs.
• Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
• Work independently and asynchronously to meet deadlines while ensuring high-quality evaluations.

Skills

English fluency

Experience (5+ years) in nonprofit/ph‌

Education

Master's degree or higher

Tools

Microsoft Office

Google Workspace

Slides

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Nonprofit / philanthropy / community programs. Evaluator Type: Contract. Compensation: $80-$120/hour. Location: Remote.

Role Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Provide clear, structured written feedback to improve AI model outputs.
• Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
• Work independently and asynchronously to meet deadlines while ensuring high-quality evaluations.

Qualifications

• 5+ years of relevant professional experience in Nonprofit / philanthropy / community programs.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace , especially Slides.
• Preferred Advanced degree ( Master's or higher ) from a reputable institution.