Remote Multilingual AI Benchmark Engineer

LILT (Production); España; Remote; EUR 83,000 - 165,000; Part time

Job summary

LILT (Production) is seeking experienced software engineers to design, build, and validate multilingual benchmarking tasks. You will create native-language assets that test model robustness in multilingual settings, with a focus on encoding, locale conventions, and safe string handling.

The role is remote and freelance. You will collaborate on high-signal tasks, develop reference implementations, and contribute to a rigorous quality control process.

Qualifications

• 5+ years of industry experience in software engineering.
• Native or near-native fluency with high English proficiency.
• Strong Python, shell scripting, and data processing skills.
• Extensive experience with Terminal/CLI-based development workflows.
• Deep understanding of multilingual text processing pitfalls.

Responsibilities

• Design, build, and validate multilingual benchmarks.
• Create high-signal tasks using native-language assets.
• Identify failure points in native languages without English translation.
• Develop reference implementations and deterministic verifier scripts.
• Calibrate task difficulty across model tiers and run configurations.
• Participate in a rigorous 4-layer quality control process with automated checks.

Skills

Python

Shell scripting

Data processing

Terminal/CLI workflows

Multilingual text processing

Unicode handling

Job description

LILT (Production) is seeking experienced software engineers to design, build, and validate multilingual benchmarking tasks. You will create native-language assets that test model robustness in multilingual settings, with a focus on encoding, locale conventions, and safe string handling.

The role is remote and freelance. You will collaborate on high-signal tasks, develop reference implementations, and contribute to a rigorous quality control process.