AI Legal Analyst & Model Evaluator (Contractor)

Turing; Los Angeles (CA); Remote; USD 68,880 - 96,432; Part time

Job summary

A leading AI company is seeking a legal professional for a contractor role focused on evaluating AI model outputs in legal contexts. Candidates must hold a Juris Doctor (J.D.) and have more than 3 years of experience in law. The role involves reviewing complex legal hypotheticals, applying structured rubrics, and providing detailed feedback. A keen interest in AI and language models is a plus. The position requires a commitment of 10 to 40 hours per week, offering flexibility and potential for extension based on performance.

Qualifications

• 3+ years of experience practicing law or teaching at a U.S.-based law school.
• Proven ability to apply U.S. legal reasoning to complex, nuanced cases.
• Strong foundational knowledge across multiple areas of U.S. law.

Responsibilities

• Review and evaluate model outputs on U.S. legal hypotheticals.
• Apply a structured legal rubric to assess accuracy and relevance.
• Identify gaps and reasoning blind spots in legal understanding.

Skills

Legal reasoning

Attention to detail

Written communication

Knowledge of U.S. law

Experience with AI/LLMs

Education

Juris Doctor (J.D.)

Job description

A leading AI company is seeking a legal professional for a contractor role focused on evaluating AI model outputs in legal contexts. Candidates must hold a Juris Doctor (J.D.) and have more than 3 years of experience in law. The role involves reviewing complex legal hypotheticals, applying structured rubrics, and providing detailed feedback. A keen interest in AI and language models is a plus. The position requires a commitment of 10 to 40 hours per week, offering flexibility and potential for extension based on performance.