Bilingual Internet Evaluator - French

mercor; Schweiz; Remoto; CHF 46.000 - 69.000; Part-time

Descrizione del lavoro

Mercor connects elite creative and technical talent with leading AI research labs. A contract role as Internet-Native Bilingual Evaluator Expert (French) is available for remote work, requiring 10-20 hours weekly and fluency in French and English. Evaluate, benchmark, and improve multilingual outputs across online communities, with rubrics and structured feedback to guide model development.

Competenze

• Native or near-native fluency in French and professional fluency in English.
• Strong writing, analytical, and critical thinking skills.
• Availability to commit 10-20 hours per week.

Mansioni

• Evaluate AI outputs for linguistic accuracy, cultural relevance, and internet authenticity in French and English.
• Analyse content from French- and English-speaking online communities to identify errors involving slang, memes, cultural references, sarcasm, and code-switching.
• Build evaluation rubrics for bilingual internet communication and define expectations for culturally appropriate and platform-native language.
• Test language models using real-world bilingual prompts and provide detailed feedback to improve performance.
• Participate in QA reviews and benchmark creation to ensure consistency across evaluators and datasets.

Conoscenze

Bilingual French/English

Writing & analytical skills

Availability 10-20 hrs/week

Descrizione del lavoro

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Internet-Native Bilingual Evaluator Expert (French) Type: Contract Compensation: $50/hour Location: Remote Commitment: 10-20 hours/week

Role Responsibilities

• Evaluate AI outputs for linguistic accuracy, cultural relevance, and internet authenticity in French and English.
• Analyse content from French- and English-speaking online communities to identify errors involving slang, memes, cultural references, sarcasm, and code-switching.
• Build evaluation rubrics for bilingual internet communication and define expectations for culturally appropriate and platform-native language.
• Test language models using real-world bilingual prompts and provide detailed feedback to improve performance.
• Participate in QA reviews and benchmark creation to ensure consistency across evaluators and datasets.

Must-Have

• Native or near-native fluency in French and professional fluency in English.
• Strong familiarity with online communities across France, Québec, Belgium, Switzerland, or other French-speaking regions.
• Active participation in internet culture across both languages.
• Strong writing, analytical, and critical thinking skills.
• Available to commit 10-20 hours per week.

Preferred

• Background in linguistics, translation, localisation, social media, journalism, humanities, or AI evaluation.
• Familiarity with differences between European French, Québec French, and other French varieties.
• Experience evaluating online content and internet-native communication.
• Interest in AI and multilingual language technologies.