User Research Expert - Evaluator

Mercor; San Francisco (CA); Hybrid; GBP 83,000 - 124,000; Part time

Job summary

Mercor is seeking a User/Customer Research and Feedback Synthesis Evaluator for a remote contract role. Compensation ranges from $80 to $120 per hour, with English fluency and advanced Microsoft Office and Google Workspace skills required.

The role involves evaluating AI-generated artifacts, identifying errors in documents, and delivering structured feedback to improve model outputs. You will work independently, asynchronously, and collaborate with subject matter experts to ensure data quality

Qualifications

• 5+ years of relevant professional experience in user/customer research and feedback synthesis.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Provide clear, structured written feedback to improve AI model outputs.
• Work independently and asynchronously to meet deadlines and enhance AI model performance.
• Collaborate with subject matter experts to ensure consistency and quality across datasets.

Skills

User research

Feedback synthesis

English fluency

MS Office

Google Workspace

Education

Advanced degree

Tools

Slides

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Provide clear, structured written feedback to improve AI model outputs.
• Work independently and asynchronously to meet deadlines and enhance AI model performance.
• Collaborate with subject matter experts to ensure consistency and quality across datasets.

Qualifications

Must-Have

• 5+ years of relevant professional experience in User/customer research and feedback synthesis.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Preferred

• Advanced degree (Master's or higher) from a reputable institution.