AI Annotation Specialist - Fully Remote | Upto $27/hr

mercor; San Francisco (CA); Hybrid; CAD 41.000 - 53.000; Vollzeit

Zusammenfassung

Mercor is seeking an AI Session Annotator (French) to review recorded sessions where users interact with an AI assistant, comparing the assistant's responses with visible video content to identify hallucinated or fabricated details.

You will score sessions on visual interpretation, accuracy, relevance, response timing, and use of spatial language, and write detailed comments with concrete evidence from the sessions.

Qualifikationen

• Native or native-level French, spoken and written.
• Clear, precise written French.
• Professional English reading comprehension.
• An Android phone with a working camera and microphone.
• Attention to detail and consistent rubric application.

Aufgaben

• Review recorded sessions where users interact with an AI assistant via voice and camera.
• Compare the assistant's responses with visible video content to identify hallucinated or fabricated details.
• Score sessions on visual interpretation, accuracy, relevance, response timing, and use of spatial language.
• Evaluate if the assistant provided timely warnings on health, safety, or financial risks.
• Write detailed comments supporting each score with concrete evidence from sessions.
• Capture conversation turns in the intake form.

Kenntnisse

French (native)

Written French

English reading

Android device

Attention to detail

Jobbeschreibung

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position

AI Session Annotator (French)

Type

Contract

Compensation

$21–$27/hour

Location

Remote

Role Responsibilities

• Review recorded sessions where users interact with an AI assistant via voice and camera.
• Compare the assistant's responses with visible video content to identify hallucinated or fabricated details.
• Score sessions on visual interpretation, accuracy, relevance, response timing, and use of spatial language.
• Evaluate if the assistant provided timely warnings on health, safety, or financial risks.
• Write detailed comments supporting each score with concrete evidence from sessions.
• Capture conversation turns in the intake form.

Qualifications

Must-Have

• Native or native-level French , spoken and written.
• Clear, precise written French.
• An Android phone with a working camera and microphone.
• Attention to detail and consistent rubric application.
• Professional English reading comprehension.

Preferred

• Experience in data annotation, linguistic QA, content moderation, or AI model evaluation.
• Training in linguistics, translation, or interpreting.
• Ability to recognize unnatural or non-native French.

Start Date

Immediate .

Work Volume

High volume of work expected between 26 to 31 Aug .

Originally posted on Himalayas