French AI Session Evaluator & Commentator

Mercor; Paris; Sur place; EUR 26 000 - 36 000; Plein temps

Résumé du poste

Mercor is seeking French-speaking reviewers in Paris to evaluate sessions with a voice-and-camera AI assistant. You will watch each session and score it against a detailed rubric, focusing on accuracy and safety considerations.

Applicants must be fluent in French and possess clear written French, plus an Android phone with camera and mic. This is judgment-driven work with high attention to detail and consistent rubric application. Start date is immediate, with high-volume activity in late August.

Qualifications

• Native or native-level French, spoken and written.
• Clear, precise written French.
• An Android phone with a working camera and microphone.
• Attention to detail and the discipline to apply a rubric consistently, without substituting criteria.
• Professional English reading comprehension; the scoring guide is in English.

Responsabilités

• Review recorded sessions where a user speaks to an AI assistant.
• Compare the assistant's responses with what is visible in the video and identify hallucinated or fabricated visual detail.
• Score sessions across visual interpretation, accuracy, relevance, and response timing.
• Judge whether the assistant warned about risks and whether warnings were timely and proportionate.
• Write detailed open comments that support every score with evidence from the session.
• Capture the conversation turn-by-turn in the intake form.

Connaissances

French language

English comprehension

Attention to detail

Rubric discipline

Outils

Android phone

Description du poste

Mercor is seeking French-speaking reviewers in Paris to evaluate sessions with a voice-and-camera AI assistant. You will watch each session and score it against a detailed rubric, focusing on accuracy and safety considerations.

Applicants must be fluent in French and possess clear written French, plus an Android phone with camera and mic. This is judgment-driven work with high attention to detail and consistent rubric application. Start date is immediate, with high-volume activity in late August.