Legal Domain Expert – AI Training & Evaluation

MPower Plus; United States; On-site; USD 80,000 - 120,000; Full time

Job summary

MPower Plus is seeking a Legal Domain Expert to support AI training and evaluation projects in the United States. The role requires hands-on experience with prompts, evaluation rubrics, and assessing AI-generated legal content for accuracy and reasoning quality.

The ideal candidate will develop legally grounded prompts, create structured rubrics, and provide actionable feedback to improve AI models. This position emphasizes direct involvement in AI training and data quality review.

Qualifications

• Hands-on AI training, grading, or model-evaluation experience.
• Practical experience writing prompts and evaluation rubrics.
• Experience assessing AI-generated legal content for accuracy and reasoning quality.

Responsibilities

• Develop legally grounded prompts and scenarios to test AI reasoning and responses.
• Write structured evaluation rubrics and grading criteria for legal accuracy, reasoning, completeness, and instruction adherence.
• Evaluate and grade AI-generated legal responses against established criteria.
• Identify inaccurate legal interpretations, unsupported conclusions, fabricated citations, and other model errors.
• Provide clear, actionable feedback and reference-quality responses to support AI model improvement.
• Apply legal subject-matter expertise to training-data development and quality review.

Skills

AI training

Rubrics writing

Prompt development

Legal accuracy evaluation

Job description

Legal Domain Expert – AI Training & Evaluation

Location: United States

Openings: 5–6

Role Overview

We are seeking legal professionals, including lawyers, attorneys, and legal counsel, with hands‑on experience supporting AI training and evaluation projects. Candidates must combine legal domain expertise with practical experience writing prompts, developing evaluation rubrics, and reviewing AI‑generated legal content.

Key Responsibilities

• Develop legally grounded prompts and scenarios to test AI reasoning and responses.
• Write structured evaluation rubrics and grading criteria for legal accuracy, reasoning, completeness, and instruction adherence.
• Evaluate and grade AI‑generated legal responses against established criteria.
• Identify inaccurate legal interpretations, unsupported conclusions, fabricated citations, and other model errors.
• Provide clear, actionable feedback and reference‑quality responses to support AI model improvement.
• Apply legal subject‑matter expertise to training‑data development and quality review.

Required Experience

• Hands‑on AI training, grading, or model‑evaluation experience.
• Practical experience writing both prompts and evaluation rubrics.
• Experience assessing AI‑generated legal content for substantive accuracy and reasoning quality.

Important: General familiarity with AI tools or AI‑assisted legal research alone does not meet the requirement. Resumes should clearly describe direct involvement in AI training, evaluation, prompt development, and rubric creation.

Assessment Process

• Candidates must complete a 30‑minute assessment.
• The assessment will be shared once candidates confirm their interest in the project.

Please submit resumes that clearly highlight:

• Legal practice areas and relevant professional experience.
• AI training or evaluation projects, including specific responsibilities.

Previously shared Legal Domain Expert profiles may also be considered, provided they meet the above requirements.