Remote AI Benchmark Engineer - Spanish (Mexico)

LILT; United States; A distancia; USD 83.000 - 165.000; A tiempo parcial

Descripción de la vacante

LILT seeks experienced native-speaking software engineers to design, build, and validate multilingual benchmarks that test language models without English translation crutches. You will create high-signal tasks in your native language and maintain assets in that language to ensure genuine multilingual handling.

This remote freelance opportunity emphasizes rigorous QA, robust reference implementations, and deterministic verifier scripts across diverse model tiers.

Formación

• 5+ years of industry experience in software engineering.
• Proven track record at leading technology companies.
• Native or near-native fluency in English with high proficiency.

Responsabilidades

• Task engineering: evaluate coding agents.
• Asset creation: build task environments in native language.
• Prompting & translation: identify failure points in native language.
• Implementation & verification: develop reference implementations and verifier scripts.
• Calibration & execution: analyze logs and calibrate task difficulty across model tiers.
• Quality assurance: participate in a 4-layer QC process with automated checks.

Conocimientos

5+ years of software engineering

Native or near-native English

Python

Shell scripting

Data processing

Terminal/CLI workflows

Educación

Bachelor's degree in Computer Science or related field

Herramientas

Python

Shell scripting

Data processing pipelines

Descripción del empleo

LILT seeks experienced native-speaking software engineers to design, build, and validate multilingual benchmarks that test language models without English translation crutches. You will create high-signal tasks in your native language and maintain assets in that language to ensure genuine multilingual handling.

This remote freelance opportunity emphasizes rigorous QA, robust reference implementations, and deterministic verifier scripts across diverse model tiers.