AI Quality Evaluator & Trainer (Remote Contract)

mercor

United States

Remote

USD 83,000 - 110,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Mercor is seeking a Generalist Expert for a remote contract role. You will evaluate AI-generated responses to ensure accuracy and depth in reasoning, and provide structured written feedback to improve AI model outputs.

The ideal candidate has a Bachelor's degree from a top-500 university, strong analytical and written communication skills, the ability to work independently, and native English fluency. This position requires independent, asynchronous work and a commitment to clear, well-evidenced

Qualifications

  • Bachelor's degree from a top-500 globally ranked university preferred.
  • Strong analytical and written communication skills.
  • Ability to work independently and follow detailed task guidelines.
  • Strong critical reading skills.
  • Native English fluency required.

Responsibilities

  • Evaluate AI-generated responses to ensure accuracy and depth in reasoning.
  • Provide structured written feedback to improve AI model outputs.
  • Identify nuances, implicit meanings, and gaps in reasoning in AI-generated content.
  • Write clear, precise, and well-evidenced rationales beyond surface-level observations.
  • Work independently and asynchronously to meet deadlines and improve AI model performance.

Skills

Analytical skills
Written communication
Independent work
Critical reading
English fluency

Education

Bachelor's degree (top-500 uni)

Job description

Mercor is seeking a Generalist Expert for a remote contract role. You will evaluate AI-generated responses to ensure accuracy and depth in reasoning, and provide structured written feedback to improve AI model outputs.

The ideal candidate has a Bachelor's degree from a top-500 university, strong analytical and written communication skills, the ability to work independently, and native English fluency. This position requires independent, asynchronous work and a commitment to clear, well-evidenced

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Quality Evaluator - Engineering Ops (Remote, Contract)
AI Quality Evaluator - Engineering Ops (Remote, Contract)

mercor • United States

Remote
USD 110,000 - 165,000
Remote AI Evaluation Specialist
Remote AI Evaluation Specialist

mercor • San Francisco (CA)

Hybrid
GBP 44,000 - 73,000
AI Reasoning Auditor (Remote, Contract)
AI Reasoning Auditor (Remote, Contract)

mercor • San Francisco (CA)

Hybrid
GBP 44,000 - 73,000
AI Quality Reviewer (Remote Contract) UK/Europe
AI Quality Reviewer (Remote Contract) UK/Europe

Mercor • San Francisco (CA)

Hybrid
GBP 52,000 - 73,000
AI Quality & Onboarding Evaluator (Remote)
AI Quality & Onboarding Evaluator (Remote)

mercor • United States

Remote
USD 110,000 - 165,000
AI Quality Evaluator, Real Estate & Hospitality (Remote)
AI Quality Evaluator, Real Estate & Hospitality (Remote)

mercor • United States

Remote
USD 110,000 - 165,000
Remote AI Quality Evaluator & Strategy Contractor
Remote AI Quality Evaluator & Strategy Contractor

mercor • San Francisco (CA)

Hybrid
AUD 158,000 - 237,000
AI QA & Competitive Intelligence Evaluator (Remote)
AI QA & Competitive Intelligence Evaluator (Remote)

Mercor • New York (NY)

Remote
USD 55,000 - 83,000
Senior AI Strategy & Quality Evaluator
Senior AI Strategy & Quality Evaluator

mercor • San Francisco (CA)

Hybrid
GBP 83,000 - 125,000
AI Quality Evaluator — Real Estate & Hospitality (Remote)
AI Quality Evaluator — Real Estate & Hospitality (Remote)

mercor • San Francisco (CA)

Hybrid
AUD 110,000 - 165,000