Contractor: AI Legal Reasoning Annotator

Turing; Pittsburgh (Allegheny County); Remote; USD 55,104 - 82,656; Part time

Job summary

A leading AI company is looking for a Legal Evaluator with a Juris Doctor to advance AI's legal applications. The role involves reviewing legal hypotheticals, applying legal rubrics, and providing precise feedback to enhance model accuracy. Ideal candidates have 3+ years in law, excellent attention to detail, and strong communication skills. This contractor role offers flexible hours, allowing for 10 to 40 hours of commitment per week, with a one-month duration and potential extensions based on performance.

Qualifications

• 3+ years of experience practicing law or teaching at a U.S.-based law school.
• Proven ability to apply U.S. legal reasoning to complex cases.
• Exceptional attention to detail in evaluating legal work.

Responsibilities

• Review and evaluate model outputs on complex U.S. legal hypotheticals.
• Apply a structured legal rubric to assess model outputs.
• Provide detailed feedback to improve model legal reasoning.

Skills

Legal reasoning

Attention to detail

Written communication

Understanding of U.S. law

Confidentiality

Education

Juris Doctor (J.D.) from an accredited U.S. law school

Job description

A leading AI company is looking for a Legal Evaluator with a Juris Doctor to advance AI's legal applications. The role involves reviewing legal hypotheticals, applying legal rubrics, and providing precise feedback to enhance model accuracy. Ideal candidates have 3+ years in law, excellent attention to detail, and strong communication skills. This contractor role offers flexible hours, allowing for 10 to 40 hours of commitment per week, with a one-month duration and potential extensions based on performance.