AI Evaluation Program Manager - Remote Contract

Mercor; San Francisco (CA); Hybrid; GBP 82,000 - 123,000; Full time

Job summary

Mercor is seeking a Contract Program Management / Implementation Planning Evaluator to assess AI-generated artifacts, identify errors, and provide structured feedback. The role emphasizes independence and async work, leveraging advanced program management experience and strong English proficiency.

Ideal candidates hold an advanced degree, are fluent in English, and are highly proficient with Microsoft Office, Google Workspace, and Slides.

Qualifications

• 5+ years of relevant professional experience in Program management / implementation planning.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Provide clear, structured written feedback to improve AI-generated work products.
• Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
• Work independently and asynchronously to ensure high-quality evaluations.

Skills

English fluency

PM experience

MS Office

Education

Advanced degree (Master's or higher)

Tools

Microsoft Office

Google Workspace

Slides

Job description

Mercor is seeking a Contract Program Management / Implementation Planning Evaluator to assess AI-generated artifacts, identify errors, and provide structured feedback. The role emphasizes independence and async work, leveraging advanced program management experience and strong English proficiency.

Ideal candidates hold an advanced degree, are fluent in English, and are highly proficient with Microsoft Office, Google Workspace, and Slides.