Remote AI Benchmark Engineer - German Multilingual Testing

lilt-production; Lavamünd; Remote; EUR 41.000 - 96.000; Vollzeit

Benefits dieser Stelle

Flexible schedule

Zusammenfassung

Lilt Production is seeking experienced native-speaking software engineers to design, build, and validate benchmarks for multilingual software challenges. You will create high-signal tasks that test a model's ability to handle multilingual data without relying on English translation.

This remote freelance role offers flexible hours as an independent contractor. You will craft task environments in your native language, ensure quality through a rigorous multi-layer review process, and contribute

Qualifikationen

• 1+ years of industry experience in software or prompt engineering.
• Proven track record at leading technology companies or graduation from top-tier engineering universities.
• Native or near-native fluency with high English proficiency and deep understanding of grammar and phrasing rules.
• Strong proficiency in Python, shell scripting, and data processing.
• Extensive experience with Terminal/CLI-based development workflows and familiarity with coding agents.
• Deep technical understanding of multilingual text processing pitfalls, including encoding/decoding, Unicode normalization, and locale-dependent conventions.

Aufgaben

• Design, build, and validate benchmarks for multilingual software challenges.
• Create high-signal tasks that test models' multilingual handling without English translation crutches.
• Develop task environments using datasets in the native language and ensure assets remain in the target language.
• Support prompt engineering, translation analysis, and adaptation of tasks across model tiers.
• Contribute deterministic verifier scripts and rubric-based judging when necessary.

Kenntnisse

Python

Shell scripting

Data processing

Prompt engineering

Terminal/CLI workflows

Jobbeschreibung

Lilt Production is seeking experienced native-speaking software engineers to design, build, and validate benchmarks for multilingual software challenges. You will create high-signal tasks that test a model's ability to handle multilingual data without relying on English translation.

This remote freelance role offers flexible hours as an independent contractor. You will craft task environments in your native language, ensure quality through a rigorous multi-layer review process, and contribute