Remote Bilingual AI Content Evaluator - French/English

mercor; France; Remote; EUR 12,000 - 25,000; Part time

Job summary

Mercor is seeking an Internet-Native Bilingual Evaluator Expert fluent in French and proficient in English to work remotely on a contract basis. The role requires evaluating AI outputs for linguistic and cultural accuracy across both French and English contexts.

You will analyze online community content, build rubrics for bilingual communication, and test models with real bilingual prompts, contributing to QA reviews and benchmark creation. 10-20 hours weekly commitment is expected.

Qualifications

• Native or near-native fluency in French and professional fluency in English.
• Strong familiarity with online communities across French-speaking regions.
• Active participation in internet culture across both languages.
• Strong writing, analytical and critical thinking skills.

Responsibilities

• Evaluate AI outputs for linguistic accuracy, cultural relevance, and internet authenticity in French and English.
• Analyse content from French- and English-speaking online communities to identify errors involving slang, memes, cultural references, sarcasm, and code-switching.
• Build evaluation rubrics for bilingual internet communication and define expectations for culturally appropriate and platform-native language.
• Test language models using real-world bilingual prompts and provide detailed feedback to improve performance.
• Participate in QA reviews and benchmark creation to ensure consistency across evaluators and datasets.

Skills

Native French

Professional English

Online communities familiarity

Job description

Mercor is seeking an Internet-Native Bilingual Evaluator Expert fluent in French and proficient in English to work remotely on a contract basis. The role requires evaluating AI outputs for linguistic and cultural accuracy across both French and English contexts.

You will analyze online community content, build rubrics for bilingual communication, and test models with real bilingual prompts, contributing to QA reviews and benchmark creation. 10-20 hours weekly commitment is expected.