AI Artifact Evaluator — Strategy & Feedback (Remote)

mercor

United States

Remote

USD 110,000 - 165,000

Part time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Mercor seeks a contract evaluator for general business strategy to assess AI-generated artifacts against domain-specific rubrics. You will work remotely, evaluate quality, and provide structured written feedback to help improve AI model performance.

You will collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets, delivering timely insights in a fast-paced environment.

Qualifications

  • 5+ years of relevant professional experience in General business strategy / management.
  • Native or professional fluency in English.
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors.
  • Provide clear, structured written feedback.
  • Work independently and asynchronously to meet deadlines while improving AI model performance.
  • Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets.

Skills

5+ years experience in general biz STR
English fluency
Microsoft Office

Education

Master's degree or higher

Tools

Google Slides

Job description

Mercor seeks a contract evaluator for general business strategy to assess AI-generated artifacts against domain-specific rubrics. You will work remotely, evaluate quality, and provide structured written feedback to help improve AI model performance.

You will collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets, delivering timely insights in a fast-paced environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Strategy & Quality Evaluator
Senior AI Strategy & Quality Evaluator

mercor • San Francisco (CA)

Hybrid
GBP 83,000 - 125,000
Remote AI Artifact Evaluator — Contract, High-Impact Feedback
Remote AI Artifact Evaluator — Contract, High-Impact Feedback

United States Digital Space LLC • United States

Remote
USD 110,000 - 165,000
AI Culture Quality Evaluator - Remote Contract
AI Culture Quality Evaluator - Remote Contract

mercor • United States

Remote
USD 110,000 - 165,000
Remote AI Quality Evaluator & Strategy Contractor
Remote AI Quality Evaluator & Strategy Contractor

mercor • San Francisco (CA)

Hybrid
AUD 158,000 - 237,000
AI QA & Competitive Intelligence Evaluator (Remote)
AI QA & Competitive Intelligence Evaluator (Remote)

Mercor • New York (NY)

Remote
USD 55,000 - 83,000
AI Compliance Evaluator — Remote Contract
AI Compliance Evaluator — Remote Contract

mercor • United States

Remote
USD 110,000 - 165,000
Remote AI Quality Evaluator & Competitive Intelligence
Remote AI Quality Evaluator & Competitive Intelligence

mercor • San Francisco (CA)

Hybrid
AUD 158,000 - 237,000
AI Artifact Quality Evaluator - CS Ops Remote
AI Artifact Quality Evaluator - CS Ops Remote

mercor • San Francisco (CA)

Hybrid
AUD 158,000 - 237,000
AI Quality Evaluator - Engineering Ops (Remote, Contract)
AI Quality Evaluator - Engineering Ops (Remote, Contract)

mercor • United States

Remote
USD 110,000 - 165,000
Remote AI Quality Evaluator for Nonprofit Programs (Contract)
Remote AI Quality Evaluator for Nonprofit Programs (Contract)

mercor • United States

Remote
USD 110,000 - 165,000