Remote Native Chinese AI Benchmark Engineer (Freelance)

LILT AI; Victoria; A distancia; ARS 83.977.000 - 178.451.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Flexible schedule

Remote work

Competitive rates

Descripción de la vacante

Lilt seeks experienced native-speaking software engineers to design, build, and validate multilingual benchmarks. You will create high-signal tasks in your native language to test a model’s multilingual handling without relying on English translation.

This remote, freelance opportunity offers flexible scheduling and collaboration with a global team, focusing on robust evaluation suites and language-specific challenges across encoding, locale rules, and UI text processing.

Formación

• 5+ years of industry experience in software engineering.
• Proven track record at leading technology companies and/or graduation from top-tier engineering universities.
• Native or near-native fluency, with a deep understanding of grammar, register, and phrasing rules. High English proficiency.
• Strong proficiency in Python, standard shell scripting, and data processing.
• Extensive experience with Terminal/CLI-based development workflows and familiarity with coding agents.
• Deep technical understanding of multilingual text processing pitfalls, including encoding/decoding robustness, locale conventions, and Unicode normalization.

Responsabilidades

• Task Engineering: Evaluating Coding Agents.
• Asset Creation: Build realistic task environments using datasets and files in your native language.
• Prompting & Translation: identify failure points where AI does not work in your native language.
• Implementation & Verification: support reference implementations and write deterministic verifier scripts.
• Calibration & Execution: analyze logs and calibrate task difficulty across model tiers.
• Quality Assurance: participate in a 4-layer quality control process plus automated checks.

Conocimientos

Python

Shell scripting

Data processing

Multilingual NLP

Descripción del empleo

Lilt seeks experienced native-speaking software engineers to design, build, and validate multilingual benchmarks. You will create high-signal tasks in your native language to test a model’s multilingual handling without relying on English translation.

This remote, freelance opportunity offers flexible scheduling and collaboration with a global team, focusing on robust evaluation suites and language-specific challenges across encoding, locale rules, and UI text processing.