Remote AI Benchmark Engineer — Multilingual Native Specialist

Lilt, Inc.

United States

À distance

USD 70 000 - 120 000

Temps partiel

14 jours+

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Résumé du poste

LILT (Production) is seeking experienced software engineers to design, build, and validate multilingual benchmarks for evaluating language models in native languages. You will create high-signal tasks, maintain assets in the target language, and test prompts without English translation crutches.

The role is remote and freelance, focusing on task engineering, dataset creation, and robust verifier scripts. Collaboration spans across a global linguistics and AI team, with flexible scheduling.

Qualifications

  • 1+ years of industry experience in software or prompt engineering.
  • Native or near-native fluency in the target language with high English proficiency.
  • Strong proficiency in Python, shell scripting, and data processing.
  • Extensive experience with Terminal/CLI-based development workflows and coding agents.
  • Deep understanding of multilingual text processing pitfalls.

Responsabilités

  • Task Engineering: Evaluating Coding Agents.
  • Asset Creation: Build language-native task environments.
  • Prompting & Translation: identify failure points in native language.
  • Implementation & Verification: develop reference implementations and verifier scripts.
  • Calibration & Execution: analyze logs and adjust task difficulty across model tiers.
  • Quality Assurance: participate in 4-layer quality control and automated checks.

Connaissances

Python
Shell scripting
Data processing
Terminal/CLI workflows

Description du poste

LILT (Production) is seeking experienced software engineers to design, build, and validate multilingual benchmarks for evaluating language models in native languages. You will create high-signal tasks, maintain assets in the target language, and test prompts without English translation crutches.

The role is remote and freelance, focusing on task engineering, dataset creation, and robust verifier scripts. Collaboration spans across a global linguistics and AI team, with flexible scheduling.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Remote Multilingual AI Benchmark Engineer (Freelance)
Remote Multilingual AI Benchmark Engineer (Freelance)

Lilt, Inc. • États-Unis

À distance
EUR 70 000 - 100 000
Flexible schedule
Prompt payments
Impactful projects
+3
Remote Technical SME & AI Benchmarking Engineer
Remote Technical SME & AI Benchmarking Engineer

Lilt, Inc. • États-Unis

À distance
USD 83 000 - 165 000
Bilingual AI SME & Engineer — Domain Specialist
Bilingual AI SME & Engineer — Domain Specialist

Lilt, Inc. • États-Unis

À distance
USD 83 000 - 138 000
Flexible schedule
Competitive payments
Meaningful AI projects
+3
Remote AI Benchmark Engineer & Native Chinese Specialist
Remote AI Benchmark Engineer & Native Chinese Specialist

lilt-production • États-Unis

À distance
USD 83 000 - 165 000
Fully remote
1099 contractor
Flexible scheduling
+1
Remote AI Benchmark Engineer: German (Austria) Expert
Remote AI Benchmark Engineer: German (Austria) Expert

lilt-production • États-Unis

À distance
USD 78 000 - 134 000
Flexible hours
Prompt payment
Fully remote freelance engagement
+1
Technical SME & AI Engineer — Language & Domain Expert
Technical SME & AI Engineer — Language & Domain Expert

Lilt, Inc. • États-Unis

À distance
USD 83 000 - 165 000
Bilingual AI Engineer & SME (English/Korean)
Bilingual AI Engineer & SME (English/Korean)

Lilt, Inc. • États-Unis

À distance
USD 83 000 - 152 000
Flexible scheduling
Global project variety
Fast payments
Remote Natural Sciences SME for AI Benchmarking
Remote Natural Sciences SME for AI Benchmarking

Lilt, Inc. • États-Unis

À distance
USD 90 000 - 130 000
Robotics Subject Matter Expert for AI Benchmarking
Robotics Subject Matter Expert for AI Benchmarking

Lilt, Inc. • États-Unis

À distance
USD 69 000 - 124 000
Your schedule, your rules.
Get paid quickly and fairly.
Work on projects that actually matter
+3
Senior SME & AI Engineer - Quant/Scientific (Remote)
Senior SME & AI Engineer - Quant/Scientific (Remote)

LILT • États-Unis

À distance
USD 67 000 - 156 000
Flexible schedule
Competitive per-project rates
Global contractor community