Remote AI Output Quality Evaluator (Contract)

mercor; United States; Remote; USD 110,000 - 165,000; Full time

Job summary

Mercor, a San Francisco-based company connecting top software and AI talent with research labs, is seeking a Contract Software/AI/IT/Data Evaluator for remote work. You will review AI-generated artifacts, grade quality, and provide clear feedback to improve model outputs.

Requires 5+ years in Software/AI/IT/Data, native or professional English, and mastery of Microsoft Office and Google Workspace (Slides). An advanced degree is preferred.

Qualifications

• 5+ years of relevant professional experience in Software / AI / IT / data.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Provide clear, structured written feedback to improve AI model outputs.
• Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
• Work independently and asynchronously to meet deadlines.

Skills

English fluency

5+ years experience

Education

Master's degree

Tools

Microsoft Office

Google Workspace

Google Slides

Job description

Mercor, a San Francisco-based company connecting top software and AI talent with research labs, is seeking a Contract Software/AI/IT/Data Evaluator for remote work. You will review AI-generated artifacts, grade quality, and provide clear feedback to improve model outputs.

Requires 5+ years in Software/AI/IT/Data, native or professional English, and mastery of Microsoft Office and Google Workspace (Slides). An advanced degree is preferred.