A complete application in a minute
Tailored resume and cover letter, ready to send.
LILT (Production) seeks experienced software engineers to design, build, and validate rigorous multilingual benchmarks for testing multilingual robustness in AI systems. This remote, freelance role focuses on creating native-language tasks and robust verification tooling to push the limits of multilingual software challenges.
You will develop high-signal tasks and assets in the target languages, ensure they remain in the native language, and participate in a strict four-layer quality-control
We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity