Remote AI Session Annotator (English) for Quality & Safety

Mercor; San Francisco (CA); Hybrid; GBP 25,000 - 31,000; Part time

Job summary

Mercor is hiring an AI Session Annotator (English) to review and score AI-assisted sessions, ensuring accuracy and safety warnings. You will work remotely, using an Android phone with camera and microphone, and provide detailed notes from each session.

Immediate start with high-volume workload; calibration tasks assess scoring consistency and comment usefulness. Experience in data annotation or linguistic QA is preferred, along with a keen eye for non-native phrasing.

Qualifications

• Native or native-level English, spoken and written.
• Clear, precise written English.
• An Android phone with a working camera and microphone.
• Attention to detail and consistent rubric application.

Responsibilities

• Review recorded sessions where users interact with an AI assistant via voice and camera.
• Compare the assistant's responses to visible video content. Identify hallucinated or fabricated visual details.
• Score sessions on visual interpretation, accuracy, relevance, response timing, and spatial language use.
• Evaluate if the assistant appropriately warned users about health, safety, or financial risks.
• Write detailed comments supporting scores with concrete session evidence.
• Capture conversation turns in the intake form.

Skills

English proficiency

Attention to detail

Android phone

Clear written English

Job description

Mercor is hiring an AI Session Annotator (English) to review and score AI-assisted sessions, ensuring accuracy and safety warnings. You will work remotely, using an Android phone with camera and microphone, and provide detailed notes from each session.

Immediate start with high-volume workload; calibration tasks assess scoring consistency and comment usefulness. Experience in data annotation or linguistic QA is preferred, along with a keen eye for non-native phrasing.