French AI Response Evaluator

Blueprint; France; Sur place; EUR 42 000 - 60 000; Plein temps

Résumé du poste

Blueprint seeks an AI Response Labeler / Annotator with deep expertise in French and the cultural context of France. The role focuses on evaluating AI-generated responses across diverse topics, ensuring accuracy, relevance, and clear guidance, with work performed primarily in English.

You will compare model outputs and apply detailed guidelines to determine the best response for user needs. Candidates should demonstrate strong analytical thinking, excellent attention to detail, and the ability

Qualifications

• Native-level or professional fluency in French.
• Strong English fluency and reading comprehension, including understanding English annotation guidelines.
• Strong general analytical and critical-thinking skills beyond language evaluation.
• Ability to evaluate content across varied topics, formats, and task types.
• Ability to explain evaluation decisions clearly and concisely.

Responsabilités

• Perform side-by-side comparisons of AI-generated responses and determine which is stronger.
• Evaluate responses for factual accuracy, relevance, completeness, clarity, reasoning, and tone.
• Assess content in English, French, or mixed, depending on scenario.
• Evaluate a broad range of content types and tasks, including single-turn and multi-turn interactions.
• Apply French cultural and regional context when evaluating language and terminology.
• Document decisions with concise rationale when required.
• Maintain high quality while completing evaluations within deadlines.

Connaissances

French fluency

English fluency

Analytical thinking

Attention to detail

Independent work

Description du poste

Blueprint seeks an AI Response Labeler / Annotator with deep expertise in French and the cultural context of France. The role focuses on evaluating AI-generated responses across diverse topics, ensuring accuracy, relevance, and clear guidance, with work performed primarily in English.

You will compare model outputs and apply detailed guidelines to determine the best response for user needs. Candidates should demonstrate strong analytical thinking, excellent attention to detail, and the ability