Contractor: AI Legal Reasoning Annotator

Turing; New York (NY); Remote; USD 14,000 - 55,000; Part time

Job summary

A leading AI company is seeking a legal professional to evaluate AI language models in real-world legal scenarios. Your role involves using your judicial expertise to review model outputs, ensuring they meet legal standards, and providing impactful feedback. Applicants should possess a Juris Doctor (J.D.) and have at least 3 years of relevant experience in law or academia. This contractor position is flexible with a minimum commitment of 10 hours per week, lasting for one month with possible extensions.

Qualifications

• Juris Doctor (J.D.) with active or inactive Bar admission.
• 3+ years of experience practicing law or teaching at a U.S.-based law school.
• Strong knowledge of contracts, torts, criminal law, constitutional law, and corporate law.

Responsibilities

• Review and evaluate model outputs on U.S. legal hypotheticals.
• Apply a legal rubric to assess model accuracy and relevance.
• Identify gaps and help define benchmarks for legal understanding.

Skills

Attention to detail

Legal reasoning

Written communication

Knowledge of U.S. law

Confidentiality handling

Education

Juris Doctor (J.D.) from an accredited U.S. law school

Job description

A leading AI company is seeking a legal professional to evaluate AI language models in real-world legal scenarios. Your role involves using your judicial expertise to review model outputs, ensuring they meet legal standards, and providing impactful feedback. Applicants should possess a Juris Doctor (J.D.) and have at least 3 years of relevant experience in law or academia. This contractor position is flexible with a minimum commitment of 10 hours per week, lasting for one month with possible extensions.