Remote AI Session Annotator (English)

Mercor; San Francisco (CA); Hybrid; GBP 25,000 - 31,000; Part time

Job summary

Mercor is seeking an AI Session Annotator (English) for a remote contract role. The annotator will review sessions where users interact with an AI assistant via voice and camera, scoring based on interpretation accuracy, relevance, and timing, and documenting evidence in the intake form.

The ideal candidate is a native English speaker with precise written English, an Android device with camera and mic, and strong attention to detail.

Qualifications

• Native or native-level English, spoken and written.
• Clear, precise written English.
• An Android phone with a working camera and microphone.
• Attention to detail and consistent rubric application.

Responsibilities

• Review recorded sessions where users interact with an AI assistant via voice and camera.
• Compare the assistant's responses to visible video content and identify hallucinated or fabricated visual details.
• Score sessions on visual interpretation, accuracy, relevance, response timing, and spatial language use.
• Evaluate if the assistant appropriately warned users about health, safety, or financial risks.
• Write detailed comments supporting scores with concrete session evidence.
• Capture conversation turns in the intake form.

Skills

Native English

Android phone with camera

Attention to detail

Education

Linguistics / translation training

Job description

Mercor is seeking an AI Session Annotator (English) for a remote contract role. The annotator will review sessions where users interact with an AI assistant via voice and camera, scoring based on interpretation accuracy, relevance, and timing, and documenting evidence in the intake form.

The ideal candidate is a native English speaker with precise written English, an Android device with camera and mic, and strong attention to detail.