User Research Expert - Evaluator

Mercor

San Francisco (CA)

On-site

GBP 81,000 - 122,000

Full time

5 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Mercor in the United Kingdom seeks an experienced User/customer research and feedback synthesis Evaluator to assess AI-generated artifacts, apply quality rubrics, and provide clear feedback.

You will work asynchronously, collaborate with subject matter experts, and rely on native English fluency and proficiency in Microsoft Office and Google Workspace, especially Slides. This is a remote contract role with competitive hourly compensation.

Qualifications

  • 5+ years of relevant professional experience in User/customer research and feedback synthesis.
  • Native or professional fluency in English.
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI model outputs.
  • Work independently and asynchronously to meet deadlines and enhance AI model performance.
  • Collaborate with subject matter experts to ensure consistency and quality across datasets.

Skills

User research
Feedback synthesis
English fluency
Microsoft Office
Google Workspace
Slides

Education

Master's degree or higher

Tools

Microsoft Office
Google Workspace
Slides

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities
  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI model outputs.
  • Work independently and asynchronously to meet deadlines and enhance AI model performance.
  • Collaborate with subject matter experts to ensure consistency and quality across datasets.
Qualifications
Must-Have
  • 5+ years of relevant professional experience in User/customer research and feedback synthesis.
  • Native or professional fluency in English.
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides.
Preferred
  • Advanced degree (Master's or higher) from a reputable institution.
Resources & Support
  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Remote User Research & AI Output Evaluator
Remote User Research & AI Output Evaluator

Mercor • Greater London

Remote
GBP 17,000 - 34,000
Remote work
Hourly engagement
Remote AI Feedback & User Research Specialist
Remote AI Feedback & User Research Specialist

Mercor • England

On-site
GBP 81,000 - 122,000
Brand & Creative Evaluator - Remote, Hourly
Brand & Creative Evaluator - Remote, Hourly

Mercor • Greater London

Remote
GBP 55,000 - 96,000
Data Science Expert - AI Evaluation
Data Science Expert - AI Evaluation

Mercor • Greater London

On-site
GBP 90,000 - 130,000
Remote Senior User Research Evaluator for AI Output Quality
Remote Senior User Research Evaluator for AI Output Quality

Obsidian • Greater London

On-site
Research Specialist - Domain Expert
Research Specialist - Domain Expert

Mercor • Greater London

On-site
GBP 20,000 - 41,000
Weekly payments
Remote work
Remote Legal Compliance Evaluator for AI Outputs
Remote Legal Compliance Evaluator for AI Outputs

Mercor • Greater London

Remote
GBP 34,000 - 55,000
Remote AI Output Evaluator for Docs & Slides
Remote AI Output Evaluator for Docs & Slides

Obsidian • Greater London

Remote
Data Science Expert - AI Evaluation
Data Science Expert - AI Evaluation

Obsidian • Greater London

On-site
GBP 70,000 - 110,000
Remote AI Evaluator: Real Estate & Hospitality
Remote AI Evaluator: Real Estate & Hospitality

Mercor • Greater London

On-site