AI Legal Reasoning Annotator (Contractor)

Turing; Denver (CO); Hybrid; USD 55,000 - 124,000; Part time

Job summary

A leading AI company is seeking a legal evaluator to review model outputs related to U.S. law. The ideal candidate will have a Juris Doctor (J.D.) and at least 3 years experience in law or legal education. Responsibilities include assessing legal hypotheticals and providing detailed feedback on model accuracy and reasoning. This contractor role offers a flexible commitment of 10 to 40 hours per week, with an initial duration of 1 month and potential for extension based on performance.

Qualifications

• 3+ years of experience practicing law or teaching at a U.S.-based law school.
• Proven ability to apply U.S. legal reasoning to complex cases.
• Strong foundational knowledge across multiple areas of U.S. law.

Responsibilities

• Review and evaluate model outputs on complex legal hypotheticals.
• Apply a structured legal rubric to assess model outputs.
• Provide clear annotations and feedback to improve model fine-tuning.

Skills

U.S. legal reasoning

Attention to detail

Written communication

Education

Juris Doctor (J.D.)

Job description

A leading AI company is seeking a legal evaluator to review model outputs related to U.S. law. The ideal candidate will have a Juris Doctor (J.D.) and at least 3 years experience in law or legal education. Responsibilities include assessing legal hypotheticals and providing detailed feedback on model accuracy and reasoning. This contractor role offers a flexible commitment of 10 to 40 hours per week, with an initial duration of 1 month and potential for extension based on performance.