Remote Legal AI Evaluation Specialist (Part-Time)

OpenTrain AI, Inc.; Northern (KY); Hybrid; USD 83,000 - 152,000; Part time

Job summary

OpenTrain AI, Inc. is seeking a legal research evaluator to review AI-generated briefs for accuracy, clarity, and prompt adherence. You will craft model memos and issue outlines that support training data quality across jurisdictions.

The role is remote, part-time contract work with candidates in the United States, Germany, India, and beyond. Strong English, JD/LLB, and familiarity with Westlaw or Lexis are preferred.

Qualifications

• JD/LLB or equivalent with substantial primary-law research experience.
• Strong ability to interpret statutes, regulations, and case law, including holdings vs. dicta and procedural posture.
• Strong citation hygiene including quotation verification, pinpoint citations, and support for each proposition.
• Ability to handle differences between jurisdictions and clearly state assumptions or limits.
• Clear and concise legal writing.
• Preferred: Westlaw, Lexis, or equivalent legal research tools.
• Strongly preferred: AI data training, editorial quality assurance, knowledge management, or legal publishing.
• Helpful: Structured legal research from issue framing through authority retrieval and synthesis.
• Helpful: Comfortable working across time zones in an hourly remote contractor setting.
• Hiring context: 850 total positions across countries.

Responsibilities

• Review AI-generated legal research for accuracy, clarity, completeness, and prompt adherence.
• Find errors in issue spotting, jurisdiction handling, authority selection, citation accuracy, and rule application.
• Write clear explanations and model legal research memos that show careful reasoning.
• Create prompts and gold-standard outputs, including issue outlines, research plans, memo templates, and authority summaries.
• Rank model responses by correctness, defensibility, citation support, and clarity.
• Test outputs for misleading certainty, jurisdictional errors, bias, and reliability across legal scenarios.

Skills

Legal research

Issue spotting

Jurisdiction handling

Citation accuracy

Rule application

Legal writing

Prompt creation

Memo templates

Authority summaries

Model evaluation

Quality testing

Education

JD/LLB or equivalent

Tools

Westlaw

Lexis

Job description

OpenTrain AI, Inc. is seeking a legal research evaluator to review AI-generated briefs for accuracy, clarity, and prompt adherence. You will craft model memos and issue outlines that support training data quality across jurisdictions.

The role is remote, part-time contract work with candidates in the United States, Germany, India, and beyond. Strong English, JD/LLB, and familiarity with Westlaw or Lexis are preferred.