Remote AI Benchmark Engineer — Spanish Language Specialist

LILT (Production); United States; Remote; USD 83,000 - 165,000; Part time

Benefits offered by this job

Remote work

Flexible schedule

Competitive rates

Job summary

LILT is building a rigorous multilingual evaluation suite for Terminal-Bench tasks to stress multilingual robustness in models. We seek experienced native-speaking software engineers to design, build, and validate benchmarks.

You will create high-signal tasks in your native language that avoid English translation crutches. This remote, freelance role offers flexible scheduling, competitive rates, and the opportunity to work with a global team of linguists and engineers on cutting-edge AI

Qualifications

• 5+ years of industry experience in software engineering.
• Proven track record at leading tech companies or top-tier universities.
• Native or near-native fluency with high English proficiency.
• Strong proficiency in Python, shell scripting, and data processing.
• Extensive experience with Terminal/CLI-based development workflows.
• Deep technical understanding of multilingual text processing pitfalls.

Responsibilities

• Design and evaluate coding agent tasks.
• Create realistic task environments using data in your native language.
• Identify failure points in native language.
• Develop reference implementations and verification scripts.
• Analyze logs and calibrate task difficulty across model tiers.
• Participate in a 4-layer human quality control process alongside automated checks.

Skills

Python

Shell scripting

Data processing

Terminal/CLI workflows

Multilingual text processing

Encoding handling

Locale handling

Native language fluency

Education

Top-tier engineering university degree

Job description

LILT is building a rigorous multilingual evaluation suite for Terminal-Bench tasks to stress multilingual robustness in models. We seek experienced native-speaking software engineers to design, build, and validate benchmarks.

You will create high-signal tasks in your native language that avoid English translation crutches. This remote, freelance role offers flexible scheduling, competitive rates, and the opportunity to work with a global team of linguists and engineers on cutting-edge AI