User Research Expert - Evaluator

Mercor; San Francisco (CA); Hybrid; AUD 154,000 - 231,000; Full time

Job summary

Mercor is seeking a remote Contract User/Customer Research and Feedback Synthesis Evaluator to join our team. You will evaluate AI-generated artifacts, identify gaps, and provide clear written feedback to improve model outputs.

Requires 5+ years of relevant experience and native or professional English fluency. Proficiency in Microsoft Office and Google Workspace, especially Slides, is essential for collaboration with SMEs and data colleagues.

Qualifications

• 5+ years of professional experience in user/customer research and feedback synthesis.
• Native or professional fluency in English.
• Proficiency in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Provide clear, structured written feedback to improve AI model outputs.
• Work independently and asynchronously to meet deadlines and enhance AI model performance.
• Collaborate with subject matter experts to ensure consistency and quality across datasets.

Skills

User/customer research & feedback

English proficiency

Education

Advanced degree (Master's or higher)

Tools

Microsoft Office

Google Workspace

Slides

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Provide clear, structured written feedback to improve AI model outputs.
• Work independently and asynchronously to meet deadlines and enhance AI model performance.
• Collaborate with subject matter experts to ensure consistency and quality across datasets.

Qualifications

Must-Have

• 5+ years of relevant professional experience in User/customer research and feedback synthesis.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Preferred

• Advanced degree (Master's or higher) from a reputable institution.