AI Model Evaluation Specialist — Remote Contract

Mercor

United Kingdom

Remote

GBP 63,000 - 84,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mercor is seeking a Business Domain Expert for an AI Model Evaluation Pilot on a remote, contract basis. The role focuses on Admin, Marketing, HR, or Accounting tasks and requires evaluating model outputs with evidence-based rationales, within a tight turnaround window.

The contractor will sign an NDA, complete a domain-specific task, review multiple model outputs, and provide detailed feedback. This is a remote hourly contract opportunity with Mercor’s support resources.

Qualifications

  • 5+ years of hands-on professional experience in Admin, Marketing, Human Resources, or Accounting.
  • Currently or recently practicing to judge work as a working professional would.
  • Ability to write a clear, specific, evidence-grounded rationale for a judgment.
  • Reliable within a short turnaround window.

Responsibilities

  • Sign an NDA before receiving any materials.
  • Solve one realistic, domain-specific task using the source files provided.
  • Review five model-generated outputs for that task. Rank them 1–5 with no ties, score each 0–100, and write evidence-based rationales citing specific parts of the output.
  • Provide structured feedback on the task itself and on the study design.
  • Work independently to complete the task within a short turnaround window.

Skills

5+ years experience (Admin/Marketing/…

Job description

Mercor is seeking a Business Domain Expert for an AI Model Evaluation Pilot on a remote, contract basis. The role focuses on Admin, Marketing, HR, or Accounting tasks and requires evaluating model outputs with evidence-based rationales, within a tight turnaround window.

The contractor will sign an NDA, complete a domain-specific task, review multiple model outputs, and provide detailed feedback. This is a remote hourly contract opportunity with Mercor’s support resources.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Scientist & AI Evaluation (Remote)
Senior Data Scientist & AI Evaluation (Remote)

Mercor • United Kingdom

Remote
GBP 125,000 - 177,000
Marketing Specialist - Fully Remote | Upto $80/Hr
Marketing Specialist - Fully Remote | Upto $80/Hr

Mercor • United Kingdom

Remote
GBP 63,000 - 84,000
Remote AI Market Research & Marketing Specialist (Contract)
Remote AI Market Research & Marketing Specialist (Contract)

Mercor • Greater London

Remote
GBP 103,000 - 185,000
AI Content Evaluator & Quality Feedback Specialist - Remote
AI Content Evaluator & Quality Feedback Specialist - Remote

Mercor • United Kingdom

Hybrid
GBP 52,000 - 73,000
Remote Data Scientist - AI Evaluation & Quality Assurance
Remote Data Scientist - AI Evaluation & Quality Assurance

Mercor • United Kingdom

Remote
GBP 104,000 - 157,000
AI Communications Evaluator - Remote Contract
AI Communications Evaluator - Remote Contract

Mercor • United Kingdom

Remote
GBP 83,000 - 125,000
Remote DevOps Engineer for AI Model Evaluation
Remote DevOps Engineer for AI Model Evaluation

Mercor • England

Hybrid
GBP 74,000 - 101,000
Remote Legal & Compliance Evaluator (Contract, 10h/wk)
Remote Legal & Compliance Evaluator (Contract, 10h/wk)

Mercor • Greater London

Hybrid
GBP 49,000 - 70,000
Remote Image-Analysis Task Writer (Contract)
Remote Image-Analysis Task Writer (Contract)

Mercor • United Kingdom

Remote
GBP 52,000 - 73,000
Remote AI Safety Reviewer - Contract
Remote AI Safety Reviewer - Contract

Mercor • England

Hybrid
GBP 41,000 - 47,000