Contractor: AI Legal Reasoning Annotator

Turing; Austin (TX); Remote; USD 41,328 - 68,880; Part time

Job summary

A leading AI company in Austin, Texas is looking for a legal expert to evaluate AI model outputs on U.S. legal cases. Candidates should have a Juris Doctor and at least 3 years’ experience practicing law or teaching. The role involves reviewing legal hypothetical cases, applying structured assessments, and providing detailed feedback to enhance AI's legal reasoning capabilities. This contractor position offers flexible hours, requiring a minimum commitment of 10 hours per week for a duration of 1 month, with potential for extension.

Qualifications

• 3+ years of experience practicing law or teaching at a U.S.-based law school.
• Proven ability to apply U.S. legal reasoning to complex cases.
• Strong foundational knowledge across multiple areas of U.S. law.

Responsibilities

• Review and evaluate model outputs on complex U.S. legal hypotheticals.
• Apply a structured legal rubric to assess accuracy and relevance.
• Identify gaps in reasoning and provide detailed feedback.

Skills

Legal reasoning

Attention to detail

Clear communication

Education

Juris Doctor (J.D.)

Job description

A leading AI company in Austin, Texas is looking for a legal expert to evaluate AI model outputs on U.S. legal cases. Candidates should have a Juris Doctor and at least 3 years’ experience practicing law or teaching. The role involves reviewing legal hypothetical cases, applying structured assessments, and providing detailed feedback to enhance AI's legal reasoning capabilities. This contractor position offers flexible hours, requiring a minimum commitment of 10 hours per week for a duration of 1 month, with potential for extension.