Lawyer

Turing

Denver (CO)

Remote

USD 82,656 - 137,760

Part time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

A leading AI company is seeking a legal evaluator to review AI model outputs related to complex U.S. law. The role requires a Juris Doctor (J.D.) from an accredited U.S. law school and 3+ years of legal experience. Responsibilities include evaluating legal hypotheticals, ensuring model accuracy, and providing detailed feedback. Flexibility in working hours (10-40 hrs/week) and potential for extension based on performance. This role offers a unique opportunity to influence the future of AI in the legal industry.

Qualifications

3+ years of experience practicing law or teaching at a U.S.-based law school.
Proven ability to apply U.S. legal reasoning to complex cases.
Strong foundational knowledge across multiple areas of U.S. law.

Responsibilities

Review and evaluate model outputs on complex U.S. legal hypotheticals.
Apply a structured legal rubric to assess model accuracy.
Identify gaps and provide detailed feedback for model improvement.

Skills

Legal reasoning skills

Attention to detail

Excellent written communication

Education

Juris Doctor (J.D.)

Job description

Turing is one of the world’s fastest-growing AI companies, pushing the boundaries of AI-assisted software development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software repositories. You’ll be working at the intersection of software engineering, open-source ecosystems, and frontier AI.

Project Overview

We’re advancing the frontier of AI by training language models to think like skilled legal professionals. Our goal is to build high-quality evaluation and training datasets that capture the real reasoning challenges lawyers and legal scholars face.

You’ll work on ambitious, high-impact projects within the legal domain: from evaluating how models handle complex hypothetical cases to refining their ability to apply U.S. law with precision and nuance. This is an opportunity to shape how AI systems learn to reason like attorneys — not just recall statutes — and directly influence the future of AI in the legal industry.

What Does a Typical Day Look Like?

You’ll work alongside top AI researchers and legal experts shaping foundational LLMs at leading AI labs to:

Review and evaluate model outputs on complex U.S. legal hypotheticals across multiple domains of law.
Apply a structured legal rubric to assess accuracy, relevance, logical reasoning, and application of law.
Identify gaps, edge cases, and reasoning blind spots — helping define new benchmarks for legal understanding in AI.
Provide clear, consistent annotations and detailed feedback that directly improve model fine-tuning and legal reasoning capabilities.

Required Skills & Experience

Juris Doctor (J.D.) from an accredited U.S. law school, with active or inactive Bar admission.
3+ years of experience practicing law or teaching at a U.S.-based law school.
Proven ability to apply U.S. legal reasoning to complex, nuanced cases (hypothetical or real-world).
Strong foundational knowledge across multiple areas of U.S. law, including contracts, torts, criminal law, constitutional law, corporate law, and civil procedure.
Exceptional attention to detail, precision, and consistency in evaluating and annotating legal work.
Excellent written communication skills for delivering clear, high-quality feedback.
High ethical standards and the ability to handle sensitive legal information with confidentiality.
Interest in AI and language models (LLMs) is a plus.
Commitment: Flexible engagement, minimum 10 hrs/week, up to 40 hrs/week.
Type: Contractor (no medical/paid leave).
Duration: 1 month with potential extensions based on performance and fit.