Remote AI Benchmark Engineer - French Language Specialist

Lilt; France; Hybride; EUR 60 000 - 90 000; Temps partiel

Avantages offerts par ce poste

Remote freelance

Flexible schedule

Competitive rates

Fast payments

Global project exposure

Résumé du poste

LILT is seeking experienced native-speaking software engineers to design, build, and validate multilingual benchmarks for Terminal-Bench tasks. You will create high-signal tasks and assets in your native language to measure robustness without English translation crutches.

This is a remote, freelance opportunity. You’ll work with a global team, set your own schedule, and receive competitive rates with prompt payments. No fixed hours; project-based collaboration across languages and locales.

Qualifications

• 5+ years of industry experience in software engineering.
• Proven track record at leading technology companies and/or graduation from top-tier engineering universities.
• Native or near-native fluency, deep understanding of grammar and phrasing rules. High English proficiency.
• Strong proficiency in Python, shell scripting, and data processing.
• Extensive experience with Terminal/CLI-based development workflows and familiarity with coding agents.
• Deep technical understanding of multilingual text processing pitfalls (Unicode, locale conventions, bidi handling).

Responsabilités

• Task Engineering: Evaluating Coding Agents.
• Asset Creation: Build environments with datasets and files in your native language, assets must stay in the target language.
• Prompting & Translation: identify failure points in your native language.
• Implementation & Verification: support reference implementations and deterministic verifier scripts.
• Calibration & Execution: analyze logs and calibrate task difficulty across model tiers.
• Quality Assurance: participate in a 4-layer QA process and automated checks.

Connaissances

Python

Shell scripting

Data processing

Terminal/CLI workflows

Coding agents

Multilingual text processing

Formation

Top-tier engineering universities

Description du poste

LILT is seeking experienced native-speaking software engineers to design, build, and validate multilingual benchmarks for Terminal-Bench tasks. You will create high-signal tasks and assets in your native language to measure robustness without English translation crutches.

This is a remote, freelance opportunity. You’ll work with a global team, set your own schedule, and receive competitive rates with prompt payments. No fixed hours; project-based collaboration across languages and locales.