Remote Multilingual AI Benchmark Engineer

Lilt; Lavamünd; Hybrid; EUR 55.000 - 110.000; Teilzeit

Benefits dieser Stelle

Remote freelance

Zusammenfassung

Lilt is seeking experienced native-speaking software engineers to design, build, and validate multilingual benchmarks for evaluating multilingual robustness in large language models. This is a remote, freelance opportunity where you will create high-signal tasks and maintain assets strictly in your native language.

You will contribute to task engineering, asset creation, prompting and translation, and verification with a focus on encoding, locale conventions, and safe string handling.

Qualifikationen

• 1+ years of industry experience in software or prompt engineering.
• Proven track record at leading technology companies and/or graduation from top-tier engineering universities.
• Native or near-native fluency with high English proficiency.
• Strong proficiency in Python, shell scripting, and data processing.
• Extensive experience with Terminal/CLI-based development workflows and familiarity with coding agents.
• Deep technical understanding of multilingual text processing pitfalls including encoding/decoding, locale conventions, and safe string operations.

Aufgaben

• Task Engineering: Evaluating Coding Agents.
• Asset Creation: Build realistic task environments using datasets and files in your native language.
• Prompting & Translation: identify failure points in your native language.
• Implementation & Verification: develop reference implementations and write reliable verifier scripts.
• Calibration & Execution: analyze logs and calibrate task difficulty across model tiers.
• Quality Assurance: participate in a 4-layer QC process with automated checks.

Kenntnisse

Software prompt engineering

Python

Shell scripting

Data processing

Terminal/CLI workflows

Ausbildung

Top-tier engineering university

Industry track record

Tools

Coding agents

Jobbeschreibung

Lilt is seeking experienced native-speaking software engineers to design, build, and validate multilingual benchmarks for evaluating multilingual robustness in large language models. This is a remote, freelance opportunity where you will create high-signal tasks and maintain assets strictly in your native language.

You will contribute to task engineering, asset creation, prompting and translation, and verification with a focus on encoding, locale conventions, and safe string handling.