Federal Litigation AI Evaluation Attorney

OpenTrain AI, Inc.; Northern (KY); Hybrid; USD 207,000 - 413,000; Part time

Job summary

OpenTrain AI, Inc. seeks experienced legal professionals to evaluate and improve AI systems used for real-world federal civil litigation, including motion practice, case-law analysis, and persuasive briefing.

This is a remote, part-time contractor role paying $150-$300 per hour, with 20+ hours weekly. Candidates should have substantial federal litigation experience and a demonstrated record of success, and be able to provide clear feedback to AI models.

Qualifications

• Substantial federal civil litigation experience with a documented record of success.
• Strong experience with federal motion practice, briefing, and case strategy.
• At least three motions won in federal civil litigation.
• Excellent written and verbal communication, close attention to detail, and strong analytical judgment.
• Ability to turn legal expertise into clear, useful feedback for AI systems.
• Experience working across legal, product, or research disciplines.
• Helpful: experience with AI, legal technology, or training programs.
• Helpful: experience with motions to dismiss, summary judgment motions, and discovery motions.

Responsibilities

• Complete simulated motion-drafting, briefing, and litigation-strategy exercises.
• Review AI responses to litigation scenarios and assess argument quality, legal analysis, and precision.
• Create objective evaluation frameworks and grading criteria for litigation tasks.
• Refine data, guidelines, and best practices for AI-supported litigation work.
• Apply consistent legal judgment to model-generated arguments, case-law analysis, and draft motions.

Skills

Federal litigation

Motion practice

Briefing

Legal analysis

Feedback to AI

Attention to detail

Written communication

Tools

AI training tools

Legal tech

Job description

The work

You will help evaluate and improve AI systems used for real-world legal work. The focus is federal civil litigation, motion practice, case-law analysis, legal reasoning, and persuasive briefing.

You will apply your courtroom experience to structured AI evaluation tasks and give clear feedback on the quality and accuracy of model-generated legal content.

• Complete simulated motion-drafting, briefing, and litigation-strategy exercises.
• Review AI responses to litigation scenarios and assess argument quality, legal analysis, and precision.
• Create objective evaluation frameworks and grading criteria for litigation tasks.
• Refine data, guidelines, and best practices for AI-supported litigation work.
• Apply consistent legal judgment to model-generated arguments, case-law analysis, and draft motions.

What it pays and takes

This is a remote, part-time contractor role. The listing is marked entry level, but the work requires substantial federal civil litigation experience and a documented record of success.

• Pay: $150-$300 per hour.
• Hours: 20 or more hours per week.
• Work setup: Remote.
• Location: Open to candidates in the countries listed for this role.
• Language: English.
• Required: Substantial experience litigating civil matters in federal court.
• Required: Strong experience with federal motion practice, briefing, and case strategy.
• Required: At least three motions won in federal civil litigation.
• Required: Excellent written and verbal communication, close attention to detail, and strong analytical judgment.
• Required: Ability to turn legal expertise into clear, useful feedback for AI systems.
• Important: Experience working across legal, product, or research disciplines.
• Helpful: Experience with AI, legal technology, or training programs.
• Helpful: Experience with motions to dismiss, summary judgment motions, and discovery motions.

About AI training work

AI training is the human work behind systems that generate and evaluate text. Experienced professionals review model outputs, identify errors, and create examples and standards that help AI produce more accurate and useful results.