Contractor: AI Legal Reasoning Annotator

Turing; Seattle (WA); Remote; USD 83,000 - 124,000; Part time

Job summary

A leading AI company is seeking a qualified legal professional to evaluate AI models in relation to U.S. law. You will assess complex legal hypotheticals, apply structured evaluations, and provide crucial feedback to improve AI legal reasoning. The ideal candidate holds a Juris Doctor and has over three years of relevant experience. This contractor role offers flexible engagement of 10 to 40 hours a week with a potential one-month duration, extending based on performance.

Qualifications

• 3+ years of experience practicing law or teaching at a U.S.-based law school.
• Strong foundational knowledge in U.S. law including contracts, torts, and more.
• High ethical standards and ability to handle sensitive legal information.

Responsibilities

• Review and evaluate model outputs on complex U.S. legal hypotheticals.
• Apply structured legal rubric to assess accuracy and logical reasoning.
• Provide clear annotations and feedback to improve model capabilities.

Skills

U.S. legal reasoning

Attention to detail

Written communication

Experience with legal hypotheticals

Education

Juris Doctor from accredited U.S. law school

Job description

A leading AI company is seeking a qualified legal professional to evaluate AI models in relation to U.S. law. You will assess complex legal hypotheticals, apply structured evaluations, and provide crucial feedback to improve AI legal reasoning. The ideal candidate holds a Juris Doctor and has over three years of relevant experience. This contractor role offers flexible engagement of 10 to 40 hours a week with a potential one-month duration, extending based on performance.