Litigation and Civil Procedure AI Evaluation Expert

OpenTrain AI, Inc.; United States; À distance; USD 83 000 - 124 000; Plein temps

Résumé du poste

OpenTrain AI, Inc. is seeking a Litigation and Civil Procedure AI Evaluation Expert for a fully remote freelance role. The position requires 20 or more hours per week and focuses on evaluating AI responses to complex U.S.

litigation scenarios to provide clear legal feedback for model improvement. You will assess motions to dismiss, summary judgment, discovery disputes, and trial strategy using a structured rubric grounded in the Federal Rules of Civil Procedure, evidence, and case law.

Qualifications

• Juris Doctor degree from an accredited U.S. law school.
• Active or inactive bar admission.
• At least 3 years of U.S. civil litigation, commercial litigation, or appellate work.
• Strong knowledge of the Federal Rules of Civil Procedure, evidence, and trial advocacy.
• Excellent written communication and analytical reasoning with attention to detail.

Responsabilités

• Review AI responses about motions to dismiss, summary judgment, discovery disputes, and trial strategy.
• Use a structured legal rubric to assess issue spotting and accuracy under the FRCP, case law, and evidence rules.
• Identify gaps involving standing, jurisdiction, burden of proof, Twombly and Iqbal pleading standards, and remedies.
• Write precise annotations and feedback, collaborating with researchers and project managers to align evaluation standards and goals.

Connaissances

Federal Rules of Civil Procedure

Evidence rules

Trial advocacy

Legal writing

Analytical reasoning

Attention to detail

Ethical judgment

Formation

Juris Doctor (JD)

Bar admission (active or inactive)

Description du poste

Litigation and Civil Procedure AI Evaluation Expert

Review AI responses to complex U.S. litigation scenarios and give clear legal feedback to improve language models. This remote freelance role requires 20 or more hours per week.

The work

You will evaluate AI-generated answers to litigation hypotheticals, using your knowledge of civil procedure, evidence, and trial strategy. Your assessments and written feedback will help improve language models.

• Review responses about motions to dismiss, summary judgment, discovery disputes, and trial strategy.
• Use a structured legal rubric to assess issue spotting and accuracy under the Federal Rules of Civil Procedure, case law, and evidence rules.
• Identify gaps involving standing, jurisdiction, burden of proof, Twombly and Iqbal pleading standards, and remedies.
• Write precise annotations and feedback, and work with researchers and project managers to align evaluation standards and project goals.

What it pays and takes

• Pay: Not provided.
• Hours: 20 or more hours per week.
• Location: Fully remote and open worldwide.
• Engagement: Freelance work expected to last about one month, with a possible extension based on performance and project needs.
• Education and admission: Juris Doctor degree from an accredited U.S. law school and active or inactive bar admission.
• Legal experience: At least three years in U.S. civil litigation, commercial litigation, or appellate work.
• Skills: Strong knowledge of the Federal Rules of Civil Procedure, evidence, and trial advocacy; clear writing, analytical reasoning, attention to detail, and ethical judgment.
• Helpful background: Experience analyzing litigation strategy, identifying procedural issues, and explaining legal conclusions clearly. Prior AI experience is not required.

About AI training work

OpenTrain is a platform for finding AI-training and data-labeling roles and building a profile to support your applications. In AI training, people evaluate and annotate examples so AI models can learn from human feedback; legal expertise is valuable for judging complex legal responses.