Insurance Subject Matter Expert (SME) – AI Evaluation

Truelancer AI; United States; Remote; USD 83,000 - 124,000; Full time

Job summary

Truelancer AI, in partnership with Wipro, seeks an Insurance SME for a Google AI initiative. This remote, 1099 contractor role focuses on evaluating and improving AI outputs within insurance workflows, including underwriting, claims, and risk processes.

You'll design rubrics, perform prompt engineering, and validate model responses for accuracy and compliance while collaborating with AI/ML teams. 35 hours per week for 4–6 months.

Qualifications

• 5+ years in Insurance Domain (underwriting, claims, risk, etc.).
• Mandatory AI experience: LLM evaluation, prompt engineering, rubric development, annotation/dataset curation, AI response validation.
• Experience with insurance platforms (Guidewire, Duck Creek) and AI tools preferred.

Responsibilities

• Evaluate AI outputs across underwriting, claims, risk, and policy workflows
• Perform LLM evaluation for accuracy, reasoning, and consistency
• Develop scoring rubrics and evaluation frameworks
• Conduct prompt engineering and response validation
• Identify errors, hallucinations, and compliance gaps
• Collaborate with AI/ML teams to improve model performance

Skills

Insurance domain expertise

AI evaluation & rubric design

Prompt engineering

Tools

ChatGPT

Gemini

Claude

Job description

Insurance Subject Matter Expert (SME) – AI Evaluation

Google AI Data Operations Project | Wipro | Truelancer

About the Role

Truelancer, in partnership with Wipro, is hiring experienced Insurance SMEs for a Google AI initiative focused on improving Large Language Models (LLMs) in insurance workflows.

Key Details

• Location: Remote (USA)
• Duration: 4–6 months (extendable)
• Type: Independent Contractor (1099)
• Commitment: 35 hrs/week

Role Overview

You will evaluate and improve AI-generated outputs across insurance use cases. The role involves AI evaluation, prompt engineering, rubric creation, and validating model responses for accuracy, compliance, and business relevance.

Responsibilities

• Evaluate AI outputs across underwriting, claims, risk, and policy workflows
• Perform LLM evaluation (accuracy, reasoning, consistency)
• Develop scoring rubrics and evaluation frameworks
• Conduct prompt engineering and response validation
• Identify errors, hallucinations, and compliance gaps
• Collaborate with AI/ML teams to improve model performance

Requirements

• 5+ years in Insurance Domain (e.g., underwriting, claims, P&C, life, health, risk, compliance)
• Mandatory AI Experience:
  • LLM/AI evaluation
  • Prompt engineering
  • Rubric development
  • Annotation / dataset curation
  • AI response validation
• Experience with insurance platforms (Guidewire, Duck Creek, etc.) and AI tools (ChatGPT, Gemini, Claude) preferred

Eligibility

• U.S. Citizen / Green Card Holder / Valid U.S. Visa

Why Join?

• Work on a high-impact Google AI project
• Collaborate with leading AI teams
• Fully remote, cutting-edge GenAI exposure

Truelancer AI verifies each project before posting. Apply on Truelancer AI; never pay to get work.