Lawyer

Turing; Denver (CO); Hybrid; USD 55,000 - 124,000; Part time

Job summary

A leading AI company is seeking a legal evaluator to review model outputs related to U.S. law. The ideal candidate will have a Juris Doctor (J.D.) and at least 3 years experience in law or legal education. Responsibilities include assessing legal hypotheticals and providing detailed feedback on model accuracy and reasoning. This contractor role offers a flexible commitment of 10 to 40 hours per week, with an initial duration of 1 month and potential for extension based on performance.

Qualifications

• 3+ years of experience practicing law or teaching at a U.S.-based law school.
• Proven ability to apply U.S. legal reasoning to complex cases.
• Strong foundational knowledge across multiple areas of U.S. law.
• Strong knowledge across contracts, torts, criminal, constitutional, corporate and civil procedure.
• Excellent attention to detail and consistency in evaluating legal work.

Responsibilities

• Review and evaluate model outputs on complex legal hypotheticals.
• Apply a structured legal rubric to assess model outputs.
• Provide clear annotations and feedback to improve model fine-tuning.
• Provide clear, consistent annotations and detailed feedback that directly improve model fine‑tuning and legal reasoning capabilities.

Skills

U.S. legal reasoning

Attention to detail

Written communication

U.S. law knowledge

Contracts & torts

Attention to detail

Written communication

Ethics & confidentiality

AI interest

Education

Juris Doctor (J.D.)

Job description

Turing is one of the world’s fastest-growing AI companies, pushing the boundaries of AI‑assisted software development. Our mission is to empower the next generation of AI systems to reason about and work with real‑world software repositories. You’ll be working at the intersection of software engineering, open‑source ecosystems, and frontier AI.

Project Overview

We’re advancing the frontier of AI by training large language models to think like skilled legal professionals. Our goal is to build high‑quality evaluation and training datasets that capture the real reasoning challenges lawyers and legal scholars face.

Typical Day

• Review and evaluate model outputs on complex U.S. legal hypotheticals across multiple domains of law.
• Apply a structured legal rubric to assess accuracy, relevance, logical reasoning, and application of law.
• Identify gaps, edge cases, and reasoning blind spots — helping define new benchmarks for legal understanding in AI.
• Provide clear, consistent annotations and detailed feedback that directly improve model fine‑tuning and legal reasoning capabilities.

Required Skills & Experience

• Juris Doctor (J.D.) from an accredited U.S. law school, with active or inactive Bar admission.
• 3+ years of experience practicing law or teaching at a U.S.-based law school.
• Proven ability to apply U.S. legal reasoning to complex, nuanced cases (hypothetical or real‑world).
• Strong foundational knowledge across multiple areas of U.S. law, including contracts, torts, criminal law, constitutional law, corporate law, and civil procedure.
• Exceptional attention to detail, precision, and consistency in evaluating and annotating legal work.
• Excellent written communication skills for delivering clear, high‑quality feedback.
• High ethical standards and the ability to handle sensitive legal information with confidentiality.
• Interest in AI and language models (LLMs) is a plus.

Contract Details

• Commitment: Flexible engagement, minimum 10 hrs/week, up to 40 hrs/week.
• Type: Contractor (no medical/paid leave).
• Duration: 1 month with potential extensions based on performance and fit.

Location: Denver, CO