Remote AI Product Roadmap Evaluator

mercor

United States

Remote

USD 110,000 - 165,000

Part time

14 days+
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Mercor, a San Francisco-based firm, connects elite creative and technical talent with AI labs. This remote, contract role focuses on evaluating AI-generated outputs against quality rubrics and providing structured feedback to improve model results.

Ideal candidates have 5+ years in product management, strong English fluency, and advanced proficiency with MS Office and Google Slides. Master's degree preferred. Flexible hours and independent work are supported.

Qualifications

  • 5+ years of experience in Product management, roadmap planning, or PRD development.
  • Native or professional fluency in English.
  • Proficiency in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI model outputs.
  • Collaborate with AI research teams to enhance training data quality.
  • Work independently and asynchronously to meet deadlines with flexible hours.

Skills

Product management
Roadmap planning
PRD development

Education

Master's degree

Tools

Microsoft Office
Google Workspace
Google Slides

Job description

Mercor, a San Francisco-based firm, connects elite creative and technical talent with AI labs. This remote, contract role focuses on evaluating AI-generated outputs against quality rubrics and providing structured feedback to improve model results.

Ideal candidates have 5+ years in product management, strong English fluency, and advanced proficiency with MS Office and Google Slides. Master's degree preferred. Flexible hours and independent work are supported.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Product Evaluator & PRD Specialist
Remote AI Product Evaluator & PRD Specialist

mercor • United States

Remote
USD 110,000 - 165,000
Remote Product Roadmap Evaluator for AI Excellence
Remote Product Roadmap Evaluator for AI Excellence

Mercor • San Francisco (CA)

Hybrid
GBP 83,000 - 125,000
Remote AI Product Launch Evaluator
Remote AI Product Launch Evaluator

mercor • San Francisco (CA)

Hybrid
GBP 83,000 - 125,000
Remote AI Output Quality Evaluator (Contract)
Remote AI Output Quality Evaluator (Contract)

mercor • United States

Remote
USD 110,000 - 165,000
Remote AI Quality Evaluator & Competitive Intelligence
Remote AI Quality Evaluator & Competitive Intelligence

mercor • San Francisco (CA)

Hybrid
AUD 158,000 - 237,000
Remote AI Investment & Credit Evaluator
Remote AI Investment & Credit Evaluator

mercor • San Francisco (CA)

Hybrid
GBP 83,000 - 125,000
Remote AI Contract Diligence Evaluator
Remote AI Contract Diligence Evaluator

mercor • United States

Remote
USD 110,000 - 165,000
Remote AI Artifacts Evaluator & Implementation Planner
Remote AI Artifacts Evaluator & Implementation Planner

mercor • San Francisco (CA)

Hybrid
AUD 158,000 - 237,000
Remote AI Training & Onboarding Evaluator
Remote AI Training & Onboarding Evaluator

mercor • San Francisco (CA)

Hybrid
GBP 83,000 - 125,000
Remote AI Quality & Customer Success Specialist
Remote AI Quality & Customer Success Specialist

mercor • United States

Remote
USD 110,000 - 165,000