Lawyer

Turing

Pittsburgh (Allegheny County)

Remote

USD 55,104 - 82,656

Part time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

A leading AI company is looking for a Legal Evaluator with a Juris Doctor to advance AI's legal applications. The role involves reviewing legal hypotheticals, applying legal rubrics, and providing precise feedback to enhance model accuracy. Ideal candidates have 3+ years in law, excellent attention to detail, and strong communication skills. This contractor role offers flexible hours, allowing for 10 to 40 hours of commitment per week, with a one-month duration and potential extensions based on performance.

Qualifications

3+ years of experience practicing law or teaching at a U.S.-based law school.
Proven ability to apply U.S. legal reasoning to complex cases.
Exceptional attention to detail in evaluating legal work.

Responsibilities

Review and evaluate model outputs on complex U.S. legal hypotheticals.
Apply a structured legal rubric to assess model outputs.
Provide detailed feedback to improve model legal reasoning.

Skills

Legal reasoning

Attention to detail

Written communication

Understanding of U.S. law

Confidentiality

Education

Juris Doctor (J.D.) from an accredited U.S. law school

Job description

Turing is one of the world’s fastest-growing AI companies, pushing the boundaries of AI-assisted software development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software repositories. You’ll be working at the intersection of software engineering, open-source ecosystems, and frontier AI.

Project Overview

We’re advancing the frontier of AI by training language models to think like skilled legal professionals. Our goal is to build high-quality evaluation and training datasets that capture the real reasoning challenges lawyers and legal scholars face.

You’ll work on ambitious, high-impact projects within the legal domain: from evaluating how models handle complex hypothetical cases to refining their ability to apply U.S. law with precision and nuance. This is an opportunity to shape how AI systems learn to reason like attorneys — not just recall statutes — and directly influence the future of AI in the legal industry.

What Does a Typical Day Look Like?

You’ll work alongside top AI researchers and legal experts shaping foundational LLMs at leading AI labs to:

Review and evaluate model outputs on complex U.S. legal hypotheticals across multiple domains of law.
Apply a structured legal rubric to assess accuracy, relevance, logical reasoning, and application of law.
Identify gaps, edge cases, and reasoning blind spots — helping define new benchmarks for legal understanding in AI.
Provide clear, consistent annotations and detailed feedback that directly improve model fine-tuning and legal reasoning capabilities.

Required Skills & Experience

Juris Doctor (J.D.) from an accredited U.S. law school, with active or inactive Bar admission.
3+ years of experience practicing law or teaching at a U.S.-based law school.
Proven ability to apply U.S. legal reasoning to complex, nuanced cases (hypothetical or real-world).
Strong foundational knowledge across multiple areas of U.S. law, including contracts, torts, criminal law, constitutional law, corporate law, and civil procedure.
Exceptional attention to detail, precision, and consistency in evaluating and annotating legal work.
Excellent written communication skills for delivering clear, high-quality feedback.
High ethical standards and the ability to handle sensitive legal information with confidentiality.
Interest in AI and language models (LLMs) is a plus.
Commitment: Flexible engagement, minimum 10 hrs/week, up to 40 hrs/week.
Type: Contractor (no medical/paid leave).
Duration: 1 month with potential extensions based on performance and fit.