Contractor: AI Legal Reasoning Annotator

Turing; Denver (CO); Remote; USD 82,656 - 137,760; Part time

Job summary

A leading AI company is seeking a legal evaluator to review AI model outputs related to complex U.S. law. The role requires a Juris Doctor (J.D.) from an accredited U.S. law school and 3+ years of legal experience. Responsibilities include evaluating legal hypotheticals, ensuring model accuracy, and providing detailed feedback. Flexibility in working hours (10-40 hrs/week) and potential for extension based on performance. This role offers a unique opportunity to influence the future of AI in the legal industry.

Qualifications

• 3+ years of experience practicing law or teaching at a U.S.-based law school.
• Proven ability to apply U.S. legal reasoning to complex cases.
• Strong foundational knowledge across multiple areas of U.S. law.

Responsibilities

• Review and evaluate model outputs on complex U.S. legal hypotheticals.
• Apply a structured legal rubric to assess model accuracy.
• Identify gaps and provide detailed feedback for model improvement.

Skills

Legal reasoning skills

Attention to detail

Excellent written communication

Education

Juris Doctor (J.D.)

Job description

A leading AI company is seeking a legal evaluator to review AI model outputs related to complex U.S. law. The role requires a Juris Doctor (J.D.) from an accredited U.S. law school and 3+ years of legal experience. Responsibilities include evaluating legal hypotheticals, ensuring model accuracy, and providing detailed feedback. Flexibility in working hours (10-40 hrs/week) and potential for extension based on performance. This role offers a unique opportunity to influence the future of AI in the legal industry.