Contractor: AI Legal Reasoning Annotator

Turing; Denver (CO); Remote; USD 96,000 - 165,000; Part time

Job summary

A leading AI company is seeking legal experts to evaluate language models as part of a project at the forefront of AI development. Candidates should hold a Juris Doctor (J.D.) and have over 3 years of legal experience. Responsibilities include assessing model performance on complex legal hypotheticals and providing detailed feedback. This contract role offers flexible hours, requiring a commitment of at least 10 hours per week, with potential for extensions based on performance. The ideal candidate has a strong understanding of U.S. law and excellent communication skills.

Qualifications

• 3+ years of experience practicing law or teaching at a U.S.-based law school.
• Strong foundational knowledge across multiple areas of U.S. law.
• Interest in AI and language models (LLMs) is a plus.

Responsibilities

• Review and evaluate model outputs on complex U.S. legal hypotheticals.
• Apply a structured legal rubric to assess accuracy and relevance.
• Identify gaps, edge cases, and reasoning blind spots.

Skills

Attention to detail

U.S. legal reasoning

Written communication

Confidentiality

Education

Juris Doctor (J.D.)

Job description

A leading AI company is seeking legal experts to evaluate language models as part of a project at the forefront of AI development. Candidates should hold a Juris Doctor (J.D.) and have over 3 years of legal experience. Responsibilities include assessing model performance on complex legal hypotheticals and providing detailed feedback. This contract role offers flexible hours, requiring a commitment of at least 10 hours per week, with potential for extensions based on performance. The ideal candidate has a strong understanding of U.S. law and excellent communication skills.