AI Legal Researcher & Annotator for LLMs

Turing; Atlanta (GA); Remote; USD 69,000 - 124,000; Part time

Job summary

A leading AI company is looking for a legal expert to evaluate AI model outputs on complex U.S. legal hypotheticals. The ideal candidate should hold a Juris Doctor degree and have over 3 years of legal experience. Responsibilities include assessing model accuracy and providing feedback to improve AI's legal reasoning capabilities. This role offers a flexible commitment of 10 to 40 hours per week for a duration of 1 month with potential extensions based on performance.

Qualifications

• Active or inactive Bar admission.
• Proven ability to apply U.S. legal reasoning to complex cases.
• High ethical standards in handling sensitive information.

Responsibilities

• Review and evaluate model outputs on legal hypotheticals.
• Apply a structured rubric to assess model performance.
• Identify reasoning gaps to define benchmarks for legal AI understanding.
• Provide annotations and feedback to improve legal reasoning.

Skills

Juris Doctor (J.D.)

3+ years of legal experience

Strong foundational knowledge of U.S. law

Attention to detail

Excellent written communication skills

Interest in AI and language models

Education

Juris Doctor from an accredited U.S. law school

Job description

A leading AI company is looking for a legal expert to evaluate AI model outputs on complex U.S. legal hypotheticals. The ideal candidate should hold a Juris Doctor degree and have over 3 years of legal experience. Responsibilities include assessing model accuracy and providing feedback to improve AI's legal reasoning capabilities. This role offers a flexible commitment of 10 to 40 hours per week for a duration of 1 month with potential extensions based on performance.