Remote AI Benchmark Engineer & Chinese Specialist (HK)

LILT (Production); Hong Kong; Hybride; HKD 689 000 - 1 240 000; Plein temps

Résumé du poste

LILT is seeking experienced native-speaking software engineers to design, build, and validate multilingual benchmarks for Terminal-Bench tasks. This remote, freelance role focuses on creating high-signal tasks in native languages to test multilingual robustness.

You will handle task engineering, asset creation, prompting, implementation and verification, calibration, and quality assurance, working with a global community of language professionals. Flexible schedule, contract-based engagement.

Qualifications

• 5+ years of software engineering experience.
• Proven track record at leading tech companies or top-tier universities.
• Native or near-native fluency with high English proficiency.
• Strong Python, shell scripting, and data processing skills.
• Extensive experience with Terminal/CLI development workflows and coding agents.
• Deep knowledge of multilingual text processing pitfalls (encoding, locale, bidi, etc.)

Responsabilités

• Task Engineering: Evaluating Coding Agents.
• Asset Creation: Build language-specific task environments where assets remain in the target language.
• Prompting & Translation: identify failure points in the native language.
• Implementation & Verification: support reference implementations and verifier scripts.
• Calibration & Execution: analyze logs and calibrate task difficulty across model tiers.
• Quality Assurance: participate in a 4-layer QC process with automated checks.

Connaissances

Python

Shell scripting

Data processing

CLI workflows

Coding agents

Multilingual NLP

Formation

Bachelor's degree in CS

Description du poste

LILT is seeking experienced native-speaking software engineers to design, build, and validate multilingual benchmarks for Terminal-Bench tasks. This remote, freelance role focuses on creating high-signal tasks in native languages to test multilingual robustness.

You will handle task engineering, asset creation, prompting, implementation and verification, calibration, and quality assurance, working with a global community of language professionals. Flexible schedule, contract-based engagement.