AI Session Annotator (Remote, English) — Detail‑Oriented QA

mercor; United States; Remote; USD 33,000 - 41,000; Full time

Job summary

Mercor is seeking an AI Session Annotator (English) for immediate start. This remote contract role involves reviewing AI-assisted sessions, verifying alignment with video content, and scoring visual interpretation, accuracy, relevance, timing and spatial language use.

You will write detailed comments with session evidence, document conversation turns, and help ensure responsible AI behavior by flagging health, safety or financial risk warnings when necessary.

Qualifications

• Native English, spoken and written.
• Clear, precise written English.
• An Android phone with a working camera and microphone.

Responsibilities

• Review recorded sessions where users interact with an AI assistant via voice and camera.
• Compare the assistant's responses to visible video content and identify hallucinated or fabricated details.
• Score sessions on visual interpretation, accuracy, relevance, response timing and spatial language use.
• Evaluate if the assistant warns users about health, safety or financial risks when relevant.
• Write detailed comments supporting scores with concrete session evidence.
• Capture conversation turns in the intake form.

Skills

Native English

Written English

Attention to detail

Android phone

Job description

Mercor is seeking an AI Session Annotator (English) for immediate start. This remote contract role involves reviewing AI-assisted sessions, verifying alignment with video content, and scoring visual interpretation, accuracy, relevance, timing and spatial language use.

You will write detailed comments with session evidence, document conversation turns, and help ensure responsible AI behavior by flagging health, safety or financial risk warnings when necessary.