Remote Bilingual AI Evaluator (French/English)

mercor; San Francisco (CA); Hybrid; CAD 32,000 - 64,000; Part time

Job summary

Mercor is seeking an Internet-Native Bilingual Evaluator Expert (French) for a remote contract role. You will evaluate AI outputs for linguistic accuracy and cultural relevance in French and English, drawing on experience with online communities across French-speaking regions.

The ideal candidate has native or near-native French and fluent English, strong writing and analytical skills, and can commit 10–20 hours per week. Prior linguistics or AI evaluation background is preferred.

Qualifications

• Native or near-native fluency in French; professional fluency in English.
• Strong writing, analytical, and critical thinking skills.
• Familiar with online communities in French-speaking regions.
• Active participation in internet culture across both languages.
• Able to commit 10–20 hours per week.
• Background in linguistics, translation, localisation, social media, journalism, humanities, or AI evaluation.

Responsibilities

• Evaluate AI outputs for linguistic accuracy, cultural relevance, and internet authenticity in French and English.
• Analyse content from French- and English-speaking online communities to identify slang, memes, cultural references, sarcasm, and code-switching.
• Build evaluation rubrics for bilingual internet communication and define expectations for culturally appropriate and platform-native language.
• Test language models using real-world bilingual prompts and provide detailed feedback to improve performance.
• Participate in QA reviews and benchmark creation to ensure consistency across evaluators and datasets.

Skills

French language fluency

English language proficiency

Writing skills

Analytical thinking

Critical thinking

Cultural awareness

Education

Linguistics/Translation background

Job description

Mercor is seeking an Internet-Native Bilingual Evaluator Expert (French) for a remote contract role. You will evaluate AI outputs for linguistic accuracy and cultural relevance in French and English, drawing on experience with online communities across French-speaking regions.

The ideal candidate has native or near-native French and fluent English, strong writing and analytical skills, and can commit 10–20 hours per week. Prior linguistics or AI evaluation background is preferred.