AI Session Quality Auditor

Mercor; San Francisco (CA); On-site; USD 45,000 - 70,000; Full time

Job summary

Mercor is hiring English-speaking reviewers to evaluate recorded sessions with a voice-and-camera AI assistant. You will watch each session, compare what the assistant said against what was visible, and score it against a detailed rubric.

Your written comments are the deliverable. This is judgment work, not volume work. Start date is immediate with high volume expected between 26 and 31 Aug.

Qualifications

• Native English, spoken and written.
• Clear, precise written English; scoring guide must be followed.
• Android phone with a working camera and microphone is mandatory.
• Attention to detail and ability to apply rubric consistently.

Responsibilities

• Review recorded sessions where a user interacts with an AI assistant and camera.
• Compare assistant statements to visible video content and identify hallucinations.
• Score sessions across interpretation, accuracy, relevance, timing, and use of directional language.
• Judge whether health, safety, or financial risks were warned about appropriately.
• Write detailed open comments with evidence from the session.
• Capture the conversation turn by turn in the intake form.

Skills

Native English

Clear English

Detail-oriented

Tools

Android Phone

Job description

Mercor is hiring English-speaking reviewers to evaluate recorded sessions with a voice-and-camera AI assistant. You will watch each session, compare what the assistant said against what was visible, and score it against a detailed rubric.

Your written comments are the deliverable. This is judgment work, not volume work. Start date is immediate with high volume expected between 26 and 31 Aug.