Multilingual AI Benchmark Engineer (French) — Remote

Lilt, Inc.

Belgique

Remote

EUR 83,000 - 165,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote work
Flexible schedule

Job summary

LILT (Production) seeks experienced software engineers to design, build, and validate rigorous multilingual benchmarks for testing multilingual robustness in AI systems. This remote, freelance role focuses on creating native-language tasks and robust verification tooling to push the limits of multilingual software challenges.

You will develop high-signal tasks and assets in the target languages, ensure they remain in the native language, and participate in a strict four-layer quality-control

Qualifications

  • 1+ years of industry experience in software engineering.
  • Proven track record at leading technology companies and/or graduation from top-tier engineering universities.
  • Native or near-native fluency, with a deep understanding of its grammar.

Responsibilities

  • Task Engineering: Evaluating Coding Agents.
  • Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling.
  • Prompting & Translation: finding failure points where AI does not work, in your native language.
  • Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary).
  • Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus).
  • Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity.

Skills

Software engineering experience
Native language fluency

Education

Top-tier engineering university degree

Job description

LILT (Production) seeks experienced software engineers to design, build, and validate rigorous multilingual benchmarks for testing multilingual robustness in AI systems. This remote, freelance role focuses on creating native-language tasks and robust verification tooling to push the limits of multilingual software challenges.

You will develop high-signal tasks and assets in the target languages, ensure they remain in the native language, and participate in a strict four-layer quality-control

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Benchmark Engineer | Native Language Specialist - French (Belgium) - Remote
AI Benchmark Engineer | Native Language Specialist - French (Belgium) - Remote

Lilt, Inc. • Belgium

Remote
EUR 83,000 - 165,000
Remote work
Flexible schedule
AI Benchmark Engineer | Native Language Specialist - French (Belgium) - Remote
AI Benchmark Engineer | Native Language Specialist - French (Belgium) - Remote

Lilt, Inc. • Belgium

Remote
USD 90,000 - 150,000
Remote freelance
Flexible schedule
Competitive rates
Remote AI Benchmark Engineer & Multilingual Specialist
Remote AI Benchmark Engineer & Multilingual Specialist

Lilt, Inc. • Belgium

Hybrid
USD 90,000 - 150,000
Remote freelance
Flexible schedule
Competitive rates
Remote French AI Trainer - Flexible, Task-Based
Remote French AI Trainer - Flexible, Task-Based

Prolific • Belgium

Remote
EUR 17,000 - 28,000
Flexible schedule
Remote French-Speaking HR Specialist for AI Training
Remote French-Speaking HR Specialist for AI Training

Agency • Belgium

Remote
EUR 9,800 - 80,000
AI/ML Engineer for EU Institutions — Remote/Hybrid
AI/ML Engineer for EU Institutions — Remote/Hybrid

Bridge351 • Evere

Hybrid
EUR 65,000 - 100,000
Health Insurance
Life Insurance
Tech Visa Support
Multilingual AI Security Engineer (Freelance, Brussels)
Multilingual AI Security Engineer (Freelance, Brussels)

Fujitsu Limited • Brussel Hoofdstad

On-site
EUR 110,000 - 220,000
AI Trainer - Advanced French Fluency (Remote - Brussels)
AI Trainer - Advanced French Fluency (Remote - Brussels)

Prolific • Brussel

Remote
EUR 27,552 - 41,328
Competitive pay rates
Flexible hours
Ability to work from home
Remote French AI Trainer — Flexible Hours
Remote French AI Trainer — Flexible Hours

Prolific • Belgium

Remote
EUR 8,300 - 17,000
French Audio Transcript Editor (AI Training)
French Audio Transcript Editor (AI Training)

Alignerr Corp. • Brussel Hoofdstad

Remote
EUR 21,000 - 41,000