AI Insurance Underwriter & Model Evaluation Expert

Mercor; New York (NY); Remote; USD 120,000 - 180,000; Full time

Job summary

Cincinnatus LLC is seeking Insurance SMEs with deep domain expertise to guide evaluation and grounding of AI model outputs for underwriting and claims tasks. You will design targeted insurance evaluations, provide actionable feedback, and help build rigorous training data alongside a leading GenAI team.

The role is a W-2 employment with Cincinnatus LLC, with placement at a top AI lab as part of an extended workforce, focusing on rigorous underwriting judgment and model evaluation.

Qualifications

• 8+ years of dedicated professional experience in insurance at a top-tier organization.
• Hands-on experience evaluating LLM/AI model outputs against rubrics or scoring criteria.
• Clear career progression in underwriting or risk roles (e.g., Underwriter → Senior Underwriter → VP).
• Ability to engage reliably for 35+ hours per week during weekdays.

Responsibilities

• Guide research and engineering teams to close knowledge gaps in underwriting, claims, and risk assessment reasoning.
• Design insurance tasks and write accurate, well-reasoned solutions grounded in real underwriting/claims practice.
• Evaluate AI model outputs against structured rubrics and provide written feedback on correctness and reasoning quality.
• Develop and refine evaluation guidelines and scoring rubrics specific to insurance tasks.
• Collaborate with other SMEs to ensure consistency and accuracy in training data.

Skills

Insurance experience

Communication skills

Problem-solving

Interpersonal skills

Job description

Cincinnatus LLC is seeking Insurance SMEs with deep domain expertise to guide evaluation and grounding of AI model outputs for underwriting and claims tasks. You will design targeted insurance evaluations, provide actionable feedback, and help build rigorous training data alongside a leading GenAI team.

The role is a W-2 employment with Cincinnatus LLC, with placement at a top AI lab as part of an extended workforce, focusing on rigorous underwriting judgment and model evaluation.