AI Benchmarking Subject Matter Expert

LILT (Production)

United States

Remote

USD 55,000 - 138,000

Full time

14 days+

Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

LILT (Production) is seeking a Subject Matter Expert to craft and review realistic scenarios across consulting, technology, and enterprise operations for an AI benchmarking project focused on Indian contexts. You will design, adapt rubrics, review outputs, and contribute to gold-standard solutions reflecting best practices in professional services, legal operations, and project management.

Ideal candidates are native Bengali speakers with strong professional English and 5+ years in related

Qualifications

Native-level Bengali with strong professional English proficiency.
5+ years of professional experience in Professional Services, Technology, Legal Services, Accounting, Audit, Consulting, or Project Management.
Understanding of professional service workflows, regulatory and compliance requirements, and Indian business environments.

Responsibilities

Design realistic Professional and Technical Services scenarios in Bengali or English grounded in Indian operational contexts (e.g., financial audits, software development workflows, IT operations, legal documentation, project delivery, stakeholder communication, compliance reviews)
Adapt structured evaluation rubrics for analytical reasoning, technical problem-solving, project coordination, and professional decision-making tasks
Review AI and human-generated responses for factual accuracy, professional standards, technical quality, and operational realism
Contribute to “gold standard” solutions reflecting best practices across Indian professional services, legal operations, accounting, project management, and technology environments