Remote AI Benchmark Engineer | Indonesian Language Specialist

Lilt Inc.; Jakarta Pusat; Remote; IDR 35,000,000 - 70,000,000; Full time

Benefits offered by this job

Remote freelance

Job summary

LILT is seeking a remote AI Benchmark Engineer who is a native Indonesian speaker to design, build, and validate multilingual benchmarks. You will create authentic tasks in the native language and develop robust verifier scripts, ensuring high-quality, non-English-translation evaluation.

The role emphasizes deep linguistic understanding, Python scripting, and CLI-based workflows. This is a freelance remote opportunity with flexible scheduling and project-based work.

Qualifications

• 5+ years of software engineering experience.
• Native or near-native fluency; high English proficiency.
• Strong Python, shell scripting, and data-processing skills.

Responsibilities

• Design, build, and validate benchmarks.
• Create high-signal tasks using native-language data.
• Develop verification scripts and reference implementations.
• Calibrate task difficulty across model tiers (Easy to Very Hard).
• Participate in a 4-layer quality control process for fairness and accuracy.

Skills

5+ years experience

Native Indonesian

Python

Shell scripting

Data processing

Terminal/CLI workflows

Tools

Python

Shell scripting

Data processing

Job description

LILT is seeking a remote AI Benchmark Engineer who is a native Indonesian speaker to design, build, and validate multilingual benchmarks. You will create authentic tasks in the native language and develop robust verifier scripts, ensuring high-quality, non-English-translation evaluation.

The role emphasizes deep linguistic understanding, Python scripting, and CLI-based workflows. This is a freelance remote opportunity with flexible scheduling and project-based work.