AI Session Quality Analyst

Mercor; Greater London; On-site; GBP 24,000 - 29,000; Full time

Job summary

Mercor is seeking English-speaking reviewers to evaluate recorded sessions with a voice-and-camera AI assistant. You will watch each session, compare the assistant's statements with the visible video, and score it according to a detailed rubric.

Your written comments are the deliverable, with issues flagged for correction prioritized first. This is judgment-based work, not volume-driven.

Qualifications

• Native or native-level English, spoken and written.
• Clear, precise written English; the scoring guide is written in English.
• An Android phone with a working camera and microphone is mandatory for the project.
• Attention to detail and the discipline to apply a rubric consistently.

Responsibilities

• Watch and evaluate recorded sessions with the AI assistant.
• Compare assistant responses to what is visible in video and identify hallucinations.
• Score sessions across visual interpretation, accuracy, relevance, timing, and use of spatial language.

Skills

English proficiency

Attention to detail

Clear written English

Job description

Mercor is seeking English-speaking reviewers to evaluate recorded sessions with a voice-and-camera AI assistant. You will watch each session, compare the assistant's statements with the visible video, and score it according to a detailed rubric.

Your written comments are the deliverable, with issues flagged for correction prioritized first. This is judgment-based work, not volume-driven.