Contractor: AI Legal Reasoning Annotator

Turing; Pittsburgh (Allegheny County); Remote; USD 41,328 - 82,656; Part time

Job summary

An innovative AI company is looking for a legal expert to evaluate AI model outputs related to complex U.S. law scenarios. The role involves detailed assessments using a structured rubric and providing feedback to improve AI legal reasoning. Ideal candidates will have a Juris Doctor (J.D.) degree, experience in practicing or teaching law, and strong communication skills. This contractor position offers flexible hours and a commitment of 10-40 hours per week, initially set for one month with potential extensions.

Qualifications

• 3+ years of experience practicing law or teaching at a U.S. law school.
• Proven ability to apply U.S. legal reasoning to complex cases.
• Interest in AI and language models is a plus.

Responsibilities

• Evaluate model outputs on U.S. legal hypotheticals.
• Assess accuracy and relevance using a structured legal rubric.
• Help define benchmarks for legal understanding in AI.

Skills

Legal reasoning

Attention to detail

Written communication

Understanding of U.S. law

Education

Juris Doctor (J.D.) from an accredited U.S. law school

Job description

An innovative AI company is looking for a legal expert to evaluate AI model outputs related to complex U.S. law scenarios. The role involves detailed assessments using a structured rubric and providing feedback to improve AI legal reasoning. Ideal candidates will have a Juris Doctor (J.D.) degree, experience in practicing or teaching law, and strong communication skills. This contractor position offers flexible hours and a commitment of 10-40 hours per week, initially set for one month with potential extensions.