AI Insurance SME: LLM Evaluation & Prompting (Remote)

Truelancer AI; United States; Remote; USD 83,000 - 124,000; Full time

Job summary

Truelancer AI, in partnership with Wipro, seeks an Insurance SME for a Google AI initiative. This remote, 1099 contractor role focuses on evaluating and improving AI outputs within insurance workflows, including underwriting, claims, and risk processes.

You'll design rubrics, perform prompt engineering, and validate model responses for accuracy and compliance while collaborating with AI/ML teams. 35 hours per week for 4–6 months.

Qualifications

• 5+ years in Insurance Domain (underwriting, claims, risk, etc.).
• Mandatory AI experience: LLM evaluation, prompt engineering, rubric development, annotation/dataset curation, AI response validation.
• Experience with insurance platforms (Guidewire, Duck Creek) and AI tools preferred.

Responsibilities

• Evaluate AI outputs across underwriting, claims, risk, and policy workflows
• Perform LLM evaluation for accuracy, reasoning, and consistency
• Develop scoring rubrics and evaluation frameworks
• Conduct prompt engineering and response validation
• Identify errors, hallucinations, and compliance gaps
• Collaborate with AI/ML teams to improve model performance

Skills

Insurance domain expertise

AI evaluation & rubric design

Prompt engineering

Tools

ChatGPT

Gemini

Claude

Job description

Truelancer AI, in partnership with Wipro, seeks an Insurance SME for a Google AI initiative. This remote, 1099 contractor role focuses on evaluating and improving AI outputs within insurance workflows, including underwriting, claims, and risk processes.

You'll design rubrics, perform prompt engineering, and validate model responses for accuracy and compliance while collaborating with AI/ML teams. 35 hours per week for 4–6 months.