Remote Technical SME & AI Benchmarking Engineer

LILT (Production); United States; Remote; USD 83,000 - 165,000; Full time

Job summary

LILT, a leader in multilingual AI verification, seeks experienced professionals to support an AI benchmarking project. The ideal candidate is a Technical SME with native-language fluency and strong English skills, able to refactor and verify code in sandboxed environments while applying deep domain knowledge.

As an independent contractor, you will design scenarios, adapt rubrics, review AI and human responses for accuracy and cultural relevance, and help craft gold-standard solutions across

Qualifications

• Native-level fluency in the target language with strong professional English proficiency.
• 5+ years of professional experience in the target domain.
• Background in one or more domain-relevant positions.
• Strong understanding of domain workflows and environments.

Responsibilities

• Design realistic scenarios in your target language or English grounded in operational contexts.
• Adapt structured evaluation rubrics.
• Review AI and human-generated responses for factual accuracy, quality, cultural appropriateness, and operational realism.
• Contribute to “gold standard” solutions reflecting best practices across the target locale and domain.

Skills

Native-language fluency

Professional English

5+ years experience in domain

Domain workflows understanding

Job description

LILT, a leader in multilingual AI verification, seeks experienced professionals to support an AI benchmarking project. The ideal candidate is a Technical SME with native-language fluency and strong English skills, able to refactor and verify code in sandboxed environments while applying deep domain knowledge.

As an independent contractor, you will design scenarios, adapt rubrics, review AI and human responses for accuracy and cultural relevance, and help craft gold-standard solutions across