AI Session Evaluator & Training Specialist

Mercor; Seattle (WA); On-site; USD 28,000 - 39,000; Full time

Job summary

Mercor is hiring English-speaking reviewers to evaluate recorded sessions with a voice-and-camera AI assistant. You will watch each session, compare what the assistant said with what was visible, and score it against a detailed rubric.

Your written comments are the deliverable, and you will flag failures for correction. This is judgment work, not volume work, with careful attention to safety and accuracy in every review.

Qualifications

• Native English proficiency, both spoken and written.
• Clear, precise written English; the scoring guide is written in English.
• An Android phone with a working camera and microphone is mandatory for the project.
• Attention to detail and the discipline to apply a rubric consistently.

Responsibilities

• Watch sessions and compare assistant dialogue to video visuals.
• Score each session on interpretation accuracy, relevance, and timing.
• Identify hallucinations or fabricated visual details.
• Assess whether safety warnings are timely and proportionate.
• Provide detailed turn-by-turn comments in the intake form.

Skills

Native English

Attention to detail

Discipline to apply rubric

Written English proficiency

Tools

Android phone

Job description

Mercor is hiring English-speaking reviewers to evaluate recorded sessions with a voice-and-camera AI assistant. You will watch each session, compare what the assistant said with what was visible, and score it against a detailed rubric.

Your written comments are the deliverable, and you will flag failures for correction. This is judgment work, not volume work, with careful attention to safety and accuracy in every review.