Contractor: AI Legal Reasoning Annotator

Turing; Pittsburgh (Allegheny County); Remote; USD 68,880 - 96,432; Part time

Job summary

A leading AI company is seeking a legal professional to evaluate AI models on U.S. law. You will review complex legal hypotheticals, providing critical feedback to improve AI legal reasoning. Candidates should hold a J.D. and have at least 3 years of experience in law. The role offers flexible working hours (10 to 40 hrs/week) and is contract-based with the potential for extensions. This position is a unique opportunity to impact the integration of AI in the legal industry.

Qualifications

• 3+ years of experience practicing law or teaching at a U.S.-based law school.
• Proven ability to apply U.S. legal reasoning to complex, nuanced cases.
• Exceptional precision in evaluating and annotating legal work.

Responsibilities

• Evaluate model outputs on complex U.S. legal hypotheticals.
• Apply a structured legal rubric to assess accuracy and reasoning.
• Provide detailed feedback to enhance model fine-tuning.

Skills

U.S. legal reasoning

Attention to detail

Written communication skills

Interest in AI and language models

Education

Juris Doctor (J.D.) from accredited U.S. law school

Job description

A leading AI company is seeking a legal professional to evaluate AI models on U.S. law. You will review complex legal hypotheticals, providing critical feedback to improve AI legal reasoning. Candidates should hold a J.D. and have at least 3 years of experience in law. The role offers flexible working hours (10 to 40 hrs/week) and is contract-based with the potential for extensions. This position is a unique opportunity to impact the integration of AI in the legal industry.