Legal AI Training & Evaluation Specialist

AppLab Systems, Inc; United States; Sur place; USD 125 000 - 178 000; Plein temps

Résumé du poste

AppLab Systems, Inc. is seeking a Legal Domain Expert to support AI training and evaluation in the United States.

The role requires hands-on experience in training, grading, and model evaluation, plus practical skills in writing prompts and evaluation rubrics for legal content. The successful candidate will assess AI-generated legal responses for accuracy and reasoning, identify errors, and provide reference-quality feedback to improve model performance.

Qualifications

• Hands‑on AI training, grading, or model‑evaluation experience.
• Practical experience writing prompts and evaluation rubrics.
• Experience assessing AI-generated legal content for quality and reasoning.

Responsabilités

• Develop prompts and scenarios to test AI reasoning and responses.
• Write structured evaluation rubrics and grading criteria for legal accuracy and reasoning.
• Evaluate and grade AI-generated legal content against established criteria.
• Identify inaccuracies, unsupported conclusions, fabricated citations, and other model errors.
• Provide actionable feedback and reference-quality responses to aid model improvement.
• Apply legal expertise to training data development and quality review.

Connaissances

AI training

Rubric writing

Prompt development

Evaluation

Description du poste

AppLab Systems, Inc. is seeking a Legal Domain Expert to support AI training and evaluation in the United States.

The role requires hands-on experience in training, grading, and model evaluation, plus practical skills in writing prompts and evaluation rubrics for legal content. The successful candidate will assess AI-generated legal responses for accuracy and reasoning, identify errors, and provide reference-quality feedback to improve model performance.