Contractor: AI Legal Reasoning Annotator

Turing; California (MO); Remote; USD 14,000 - 55,000; Part time

Job summary

A leading AI company is seeking a legal professional to evaluate and annotate outputs from AI language models. You will leverage your legal expertise to assess U.S. law applications in hypothetical cases and provide structured feedback. This contractor role demands a Juris Doctor and requires a minimum commitment of 10 hours per week, with the potential for up to 40 hours. The position offers flexibility and may extend beyond the initial month based on performance.

Qualifications

• 3+ years of experience practicing law or teaching at a U.S.-based law school.
• Exceptional attention to detail and consistency in evaluating legal work.
• Interest in AI and language models (LLMs) is a plus.

Responsibilities

• Review model outputs on U.S. legal hypotheticals across multiple domains.
• Apply a structured legal rubric to assess accuracy and reasoning.
• Provide annotations and detailed feedback for AI model improvement.

Skills

Legal reasoning application

Attention to detail

Written communication

Education

Juris Doctor (J.D.)

Job description

A leading AI company is seeking a legal professional to evaluate and annotate outputs from AI language models. You will leverage your legal expertise to assess U.S. law applications in hypothetical cases and provide structured feedback. This contractor role demands a Juris Doctor and requires a minimum commitment of 10 hours per week, with the potential for up to 40 hours. The position offers flexibility and may extend beyond the initial month based on performance.