Contractor: AI Legal Reasoning Annotator

Turing; Los Angeles (CA); Remote; USD 82,656 - 137,760; Part time

Job summary

A leading AI firm in California seeks a legal expert to evaluate language models focused on U.S. law. The role requires a Juris Doctor (J.D.) and 3+ years of legal experience, emphasizing the application of complex legal reasoning. Candidates will review model outputs, provide detailed feedback, and help set new benchmarks for legal understanding in AI. This contractor position allows for a flexible commitment of 10 to 40 hours per week, aiming to influence the future of AI in the legal industry.

Qualifications

• Minimum 3 years of experience in law or legal education.
• Strong knowledge of U.S. law across multiple areas.
• Exceptional ethics and confidentiality.

Responsibilities

• Review and evaluate legal model outputs on complex hypotheticals.
• Apply a structured rubric for assessing legal reasoning.
• Provide detailed feedback to improve model performance.

Skills

U.S. legal reasoning

Attention to detail

Written communication

Education

Juris Doctor (J.D.)

Job description

A leading AI firm in California seeks a legal expert to evaluate language models focused on U.S. law. The role requires a Juris Doctor (J.D.) and 3+ years of legal experience, emphasizing the application of complex legal reasoning. Candidates will review model outputs, provide detailed feedback, and help set new benchmarks for legal understanding in AI. This contractor position allows for a flexible commitment of 10 to 40 hours per week, aiming to influence the future of AI in the legal industry.