Legal Domain Expert – AI Training & Evaluation

AppLab Systems, Inc; United States; On-site; USD 125,000 - 178,000; Full time

Job summary

AppLab Systems, Inc. is seeking a Legal Domain Expert to support AI training and evaluation in the United States.

The role requires hands-on experience in training, grading, and model evaluation, plus practical skills in writing prompts and evaluation rubrics for legal content. The successful candidate will assess AI-generated legal responses for accuracy and reasoning, identify errors, and provide reference-quality feedback to improve model performance.

Qualifications

• Hands‑on AI training, grading, or model‑evaluation experience.
• Practical experience writing prompts and evaluation rubrics.
• Experience assessing AI-generated legal content for quality and reasoning.

Responsibilities

• Develop prompts and scenarios to test AI reasoning and responses.
• Write structured evaluation rubrics and grading criteria for legal accuracy and reasoning.
• Evaluate and grade AI-generated legal content against established criteria.
• Identify inaccuracies, unsupported conclusions, fabricated citations, and other model errors.
• Provide actionable feedback and reference-quality responses to aid model improvement.
• Apply legal expertise to training data development and quality review.

Skills

AI training

Rubric writing

Prompt development

Evaluation

Job description

Legal Domain Expert – AI Training & Evaluation

Location: United States

Openings: 5–6

Pay Rate: $110-/hour/ 1099

Role Overview

We are seeking legal professionals, including lawyers, attorneys, and legal counsel, with hands‑on experience supporting AI training and evaluation projects. Candidates must combine legal domain expertise with practical experience writing prompts, developing evaluation rubrics, and reviewing AI-generated legal content.

Key Responsibilities

• Develop legally grounded prompts and scenarios to test AI reasoning and responses.
• Write structured evaluation rubrics and grading criteria for legal accuracy, reasoning, completeness, and instruction adherence.
• Evaluate and grade AI-generated legal responses against established criteria.
• Identify inaccurate legal interpretations, unsupported conclusions, fabricated citations, and other model errors.
• Provide clear, actionable feedback and reference-quality responses to support AI model improvement.
• Apply legal subject‑matter expertise to training‑data development and quality review.

Required Experience

• Hands‑on AI training, grading, or model‑evaluation experience.
• Practical experience writing both prompts and evaluation rubrics.
• Experience assessing AI-generated legal content for substantive accuracy and reasoning quality.