Senior AI Benchmark SME for Quant, Science & Corporate

Lilt; United States; Remote; USD 90,000 - 130,000; Part time

Job summary

Lilt in the United States seeks a Technical Subject Matter Expert / AI Engineer to support a cutting-edge AI benchmarking project. You will work in sandboxed environments, refactor code, and verify execution while applying deep contextual domain knowledge.

You will design scenarios in your target language or English, adapt evaluation rubrics, review AI and human responses for accuracy and cultural relevance, and contribute to gold-standard solutions across domains.

Qualifications

• Native-level fluency in the target language and strong professional English proficiency.
• 5+ years of professional experience in the target domain.
• Background in one or more domain-relevant roles.
• Strong understanding of domain workflows and environments.

Responsibilities

• Design realistic scenarios in your target language or English grounded in operational contexts.
• Adapt structured evaluation rubrics.
• Review AI and human-generated responses for factual accuracy, quality, cultural appropriateness, and operational realism.
• Contribute to “gold standard” solutions reflecting best practices across the target locale and domain.

Skills

Native-language fluency

English proficiency

5+ years experience

Domain background

Job description

Lilt in the United States seeks a Technical Subject Matter Expert / AI Engineer to support a cutting-edge AI benchmarking project. You will work in sandboxed environments, refactor code, and verify execution while applying deep contextual domain knowledge.

You will design scenarios in your target language or English, adapt evaluation rubrics, review AI and human responses for accuracy and cultural relevance, and contribute to gold-standard solutions across domains.