Remote AI Session Annotator (English) – Visual QA & Safety

mercor; Australia; Remote; AUD 47,000 - 59,000; Part time

Job summary

Mercor is seeking an AI Session Annotator to review recorded interactions between users and an AI assistant. This remote contract role requires precise English writing and careful scoring using a detailed rubric.

You will assess visual content alignment, verify health/safety warnings, and provide concrete feedback with session evidence. Start date is immediate; high volume of work expected between 26 to 31 Aug.

Qualifications

• Native or native-level English, spoken and written.
• Clear, precise written English.
• An Android phone with a working camera and microphone.
• Attention to detail and consistent rubric application.

Responsibilities

• Review recorded sessions where users interact with an AI assistant via voice and camera.
• Compare the assistant's responses to visible video content. Identify hallucinated or fabricated visual details.
• Score sessions on visual interpretation, accuracy, relevance, response timing, and spatial language use.
• Evaluate if the assistant appropriately warned users about health, safety, or financial risks.
• Write detailed comments supporting scores with concrete session evidence.
• Capture conversation turns in the intake form.

Skills

Native English

Clear written English

Attention to detail

Rubric adherence

Job description

Mercor is seeking an AI Session Annotator to review recorded interactions between users and an AI assistant. This remote contract role requires precise English writing and careful scoring using a detailed rubric.

You will assess visual content alignment, verify health/safety warnings, and provide concrete feedback with session evidence. Start date is immediate; high volume of work expected between 26 to 31 Aug.