AI Quality Evaluator (Remote Contract)

Mercor

San Francisco (CA)

Hybrid

GBP 83,000 - 125,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Mercor is seeking an experienced Engineering / manufacturing / technical operations Evaluator for a remote, contract-based role. You will assess AI-generated artifacts against domain rubrics, identify errors, and provide structured feedback to help improve AI model performance.

The ideal candidate has 5+ years in engineering or manufacturing, native or professional English, and strong command of Microsoft Office and Google Workspace, especially Slides. Master's degree preferred.

Qualifications

  • 5+ years of relevant professional experience in Engineering / manufacturing / technical operations.
  • Native or professional fluency in English.
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors.
  • Provide clear, structured written feedback.
  • Review and assess AI-generated work products for accuracy, rigor, and domain quality.
  • Apply deep subject-matter expertise to grade outputs.
  • Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

5+ years experience in Engineering/制造/
English fluency
MS Office & Google Workspace (Slides)

Education

Master's degree or higher

Tools

Slides

Job description

Mercor is seeking an experienced Engineering / manufacturing / technical operations Evaluator for a remote, contract-based role. You will assess AI-generated artifacts against domain rubrics, identify errors, and provide structured feedback to help improve AI model performance.

The ideal candidate has 5+ years in engineering or manufacturing, native or professional English, and strong command of Microsoft Office and Google Workspace, especially Slides. Master's degree preferred.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Quality Evaluator & Feedback Specialist
Remote AI Quality Evaluator & Feedback Specialist

Mercor • San Francisco (CA)

Hybrid
GBP 83,000 - 124,000
AI Quality Evaluator for Public Admin (Remote Contract)
AI Quality Evaluator for Public Admin (Remote Contract)

Mercor • San Francisco (CA)

Hybrid
GBP 84,000 - 125,000
Education Evaluator & AI Quality Analyst (Remote)
Education Evaluator & AI Quality Analyst (Remote)

Mercor • San Francisco (CA)

Hybrid
GBP 83,000 - 125,000
AI Quality Evaluator for Nonprofit Philanthropy (Remote)
AI Quality Evaluator for Nonprofit Philanthropy (Remote)

Mercor • San Francisco (CA)

Hybrid
GBP 83,000 - 124,000
AI Data Quality & CRM Ops Evaluator (Remote Contract)
AI Data Quality & CRM Ops Evaluator (Remote Contract)

Mercor • San Francisco (CA)

Hybrid
GBP 84,000 - 125,000
Remote IEP Evaluator for AI Quality & Feedback
Remote IEP Evaluator for AI Quality & Feedback

Mercor • San Francisco (CA)

Hybrid
GBP 83,000 - 125,000
AI Procurement & Vendor Eval Specialist (Remote, Contract)
AI Procurement & Vendor Eval Specialist (Remote, Contract)

Mercor • San Francisco (CA)

Hybrid
GBP 83,000 - 125,000
Remote contract
Remote Healthcare Ops Evaluator for AI Quality
Remote Healthcare Ops Evaluator for AI Quality

Mercor • San Francisco (CA)

Hybrid
GBP 83,000 - 125,000
Remote Finance Specialist (Contract) - AI Evaluation
Remote Finance Specialist (Contract) - AI Evaluation

Mercor • San Francisco (CA)

Hybrid
GBP 84,000 - 125,000
Remote work
Remote Manufacturing AI Auditor (Contract)
Remote Manufacturing AI Auditor (Contract)

Mercor • San Francisco (CA)

Hybrid
GBP 57,000 - 68,000