Independent SME AI Engineer – Domain Benchmarking

Lilt; United States; Remote; USD 90,000 - 140,000; Full time

Benefits offered by this job

Independent contractor

Competitive rates

Global community

Diverse projects

Job summary

LILT is seeking experienced professionals to support a cutting-edge AI benchmarking project across specialized professional silos. The contractor should be a Technical SME/AI Engineer with localized fluency in a target language and the ability to refactor and verify code execution in sandboxed environments while applying deep domain knowledge.

You will design scenarios, adapt rubrics, review AI and human responses for accuracy and cultural relevance, and contribute to gold-standard solutions

Qualifications

• Native-level fluency in the target language with strong professional English proficiency.
• 5+ years of professional experience in the target domain.
• Background in one or more domain-relevant positions.
• Strong understanding of domain workflows and environments.

Responsibilities

• Design realistic scenarios in the target language or English grounded in operational contexts.
• Adapt structured evaluation rubrics.
• Review AI and human-generated responses for factual accuracy, quality, cultural appropriateness, and operational realism.
• Contribute to gold standard solutions reflecting best practices across the target locale and domain.

Skills

Native language fluency

English proficiency

5+ years experience

Domain knowledge

Job description

LILT is seeking experienced professionals to support a cutting-edge AI benchmarking project across specialized professional silos. The contractor should be a Technical SME/AI Engineer with localized fluency in a target language and the ability to refactor and verify code execution in sandboxed environments while applying deep domain knowledge.

You will design scenarios, adapt rubrics, review AI and human responses for accuracy and cultural relevance, and contribute to gold-standard solutions