Remote Product Roadmap Evaluator for AI Quality

Mercor; Sydney; Remote; AUD 162,000 - 243,000; Part time

Job summary

Mercor is seeking a contract Product management / roadmap / PRD Evaluator to assess AI-generated artifacts and provide structured feedback. The role focuses on quality rubrics, accuracy, and presentation across documents and decks, with remote work and flexible hours.

Native English speakers with 5+ years in product management and strong MS Office/Google Workspace skills (Slides) are preferred. Advanced degree is a plus.

Qualifications

• 5+ years of relevant professional experience in Product management / roadmap / PRD.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Provide clear, structured written feedback to improve AI model outputs.
• Collaborate with AI research teams to enhance training data quality.
• Work independently and asynchronously to meet deadlines with flexible hours.

Skills

Product management / roadmap / PRD

English fluency

Education

Master’s degree or higher

Tools

Microsoft Office

Google Workspace

Slides

Job description

Mercor is seeking a contract Product management / roadmap / PRD Evaluator to assess AI-generated artifacts and provide structured feedback. The role focuses on quality rubrics, accuracy, and presentation across documents and decks, with remote work and flexible hours.

Native English speakers with 5+ years in product management and strong MS Office/Google Workspace skills (Slides) are preferred. Advanced degree is a plus.