Remote Bilingual AI Evaluator — French/English

mercor; Belgique; Remote; EUR 49,000 - 74,000; Full time

Job summary

Mercor is seeking an Internet-Native Bilingual Evaluator Expert fluent in French and English to assess AI outputs for linguistic accuracy and cultural relevance. This remote contract role requires 10-20 hours per week and pays $50 per hour.

You will analyze French- and English-speaking online communities, build evaluation rubrics, and test language models with bilingual prompts. Remote, contract work with flexible hours across time zones and a focus on internet-native language and cultural

Qualifications

• Native French with professional English proficiency.
• Familiar with online communities in Francophone regions.
• Able to commit 10–20 hours per week.
• Strong writing, analytical and critical thinking skills.

Responsibilities

• Evaluate AI outputs for linguistic accuracy, cultural relevance, and internet authenticity in French and English.
• Analyse content from French- and English-speaking online communities to identify errors involving slang, memes, cultural references, sarcasm, and code-switching.
• Build evaluation rubrics for bilingual internet communication and define expectations for culturally appropriate and platform-native language.
• Test language models using real-world bilingual prompts and provide detailed feedback to improve performance.
• Participate in QA reviews and benchmark creation to ensure consistency across evaluators and datasets.

Skills

French language

English language

Analytical thinking

Strong writing

Internet culture familiarity

Part-time availability

Job description

Mercor is seeking an Internet-Native Bilingual Evaluator Expert fluent in French and English to assess AI outputs for linguistic accuracy and cultural relevance. This remote contract role requires 10-20 hours per week and pays $50 per hour.

You will analyze French- and English-speaking online communities, build evaluation rubrics, and test language models with bilingual prompts. Remote, contract work with flexible hours across time zones and a focus on internet-native language and cultural