Remote Korean Linguistic QA Annotator (Contract)

Mercor; Sydney; On-site; AUD 46,000 - 58,000; Full time

Job summary

Mercor is seeking a Korea-speaking AI Session Annotator to review recorded user interactions with an AI assistant via voice and video, scoring accuracy, relevance, and timing. You’ll compare responses against on-screen content and note hallucinations, spatial language use, and safety warnings, providing detailed rubrics-based comments.

This is a remote contract role with immediate start and a high-volume workload.

Qualifications

• Native or native-level Korean, spoken and written.
• Clear, precise written Korean.
• An Android phone with a working camera and microphone.
• Attention to detail and consistent rubric application.
• Professional English reading comprehension.

Responsibilities

• Review recorded sessions where users interact with an AI assistant via voice and camera.
• Compare the assistant's responses to visible video content. Identify hallucinated or fabricated details.
• Score sessions on visual interpretation, accuracy, relevance, and response timing.
• Evaluate the assistant's use of spatial and directional language.
• Judge the appropriateness and timing of warnings related to health, safety, or financial security.
• Write detailed comments supporting scores with concrete session evidence.

Skills

Korean language

English reading

Attention to detail

Job description

Mercor is seeking a Korea-speaking AI Session Annotator to review recorded user interactions with an AI assistant via voice and video, scoring accuracy, relevance, and timing. You’ll compare responses against on-screen content and note hallucinations, spatial language use, and safety warnings, providing detailed rubrics-based comments.

This is a remote contract role with immediate start and a high-volume workload.