Remote Legal AI Evaluation Specialist

OpenTrain AI, Inc.; United States; Hybrid; USD 69,000 - 158,000; Part time

Job summary

OpenTrain AI is seeking a Legal AI Evaluation Expert to review AI-generated legal analyses, assess reasoning quality, and provide precise written feedback. This remote contractor role focuses on accuracy, citation support, and high-quality explanations.

You will compare multiple model responses, rank them by correctness and reasoning quality, and flag inaccuracies to help improve legal reasoning in AI systems. Expect 20+ hours per week as a contractor.

Qualifications

• Law degree or equivalent background in Law, Legal Studies, Public Policy, or Political Science.

Responsibilities

• Review AI-generated legal analyses and expert legal content for accuracy and completeness.
• Evaluate issue spotting, legal reasoning, statutory interpretation, and adherence to prompts.
• Fact-check citations, governing rules, jurisdictional posture, and doctrinal statements.
• Write clear feedback, structured explanations, and model solutions for improvement.
• Compare and rank multiple responses by correctness, reasoning quality, and clarity.
• Identify inaccuracies, bias, logical weaknesses, and procedural errors in model outputs.

Skills

Legal reasoning

Issue spotting

Citations & doctrine

English proficiency

Education

Law degree or equivalent

Job description

OpenTrain AI is seeking a Legal AI Evaluation Expert to review AI-generated legal analyses, assess reasoning quality, and provide precise written feedback. This remote contractor role focuses on accuracy, citation support, and high-quality explanations.

You will compare multiple model responses, rank them by correctness and reasoning quality, and flag inaccuracies to help improve legal reasoning in AI systems. Expect 20+ hours per week as a contractor.