Contractor: AI Legal Reasoning Annotator

Turing; Washington (District of Columbia); Remote; USD 55,000 - 96,000; Part time

Job summary

A leading AI company is seeking a legal evaluator to enhance AI models with practical legal reasoning. This remote contractor role requires a Juris Doctor (J.D.) degree and at least 3 years of legal practice or teaching experience. Candidates will review U.S. legal hypotheticals, assess model performance, and provide impactful feedback. The position offers flexible hours ranging from 10 to 40 hours per week, initially for one month with potential for extension based on performance.

Qualifications

• 3+ years of experience practicing law or teaching at a U.S.-based law school.
• Ability to apply U.S. legal reasoning to complex, nuanced cases.
• Interest in AI and language models (LLMs) is a plus.

Responsibilities

• Review and evaluate model outputs on U.S. legal hypotheticals.
• Apply legal rubric to assess accuracy and application of law.
• Provide clear annotations and feedback to improve model capabilities.

Skills

U.S. legal reasoning

Attention to detail

Written communication

Knowledge of U.S. law

Education

Juris Doctor (J.D.) from accredited U.S. law school

Job description

A leading AI company is seeking a legal evaluator to enhance AI models with practical legal reasoning. This remote contractor role requires a Juris Doctor (J.D.) degree and at least 3 years of legal practice or teaching experience. Candidates will review U.S. legal hypotheticals, assess model performance, and provide impactful feedback. The position offers flexible hours ranging from 10 to 40 hours per week, initially for one month with potential for extension based on performance.