Lawyer

Turing; New York (NY); Remote; USD 14,000 - 55,000; Part time

Job summary

A leading AI company is seeking a legal professional to evaluate AI language models in real-world legal scenarios. Your role involves using your judicial expertise to review model outputs, ensuring they meet legal standards, and providing impactful feedback. Applicants should possess a Juris Doctor (J.D.) and have at least 3 years of relevant experience in law or academia. This contractor position is flexible with a minimum commitment of 10 hours per week, lasting for one month with possible extensions.

Qualifications

• Juris Doctor (J.D.) with active or inactive Bar admission.
• 3+ years of experience practicing law or teaching at a U.S.-based law school.
• Strong knowledge of contracts, torts, criminal law, constitutional law, and corporate law.
• Broad knowledge of U.S. law: contracts, torts, criminal, constitutional, corporate, civil procedure.

Responsibilities

• Review and evaluate model outputs on U.S. legal hypotheticals.
• Apply a legal rubric to assess model accuracy and relevance.
• Identify gaps and help define benchmarks for legal understanding.
• Provide clear, consistent annotations and detailed feedback that directly improve model fine-tuning and legal reasoning capabilities.

Skills

Attention to detail

Legal reasoning

Written communication

Knowledge of U.S. law

Confidentiality handling

Confidentiality

Ethics

Contracts law

Torts

Constitutional law

Corporate law

Civil procedure

Education

Juris Doctor (J.D.) from an accredited U.S. law school

Bar admission

Job description

Turing is one of the world’s fastest-growing AI companies, pushing the boundaries of AI-assisted software development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software repositories. You’ll be working at the intersection of software engineering, open-source ecosystems, and frontier AI.

Project Overview

We’re advancing the frontier of AI by training language models to think like skilled legal professionals. Our goal is to build high-quality evaluation and training datasets that capture the real reasoning challenges lawyers and legal scholars face.

You’ll work on ambitious, high-impact projects within the legal domain: from evaluating how models handle complex hypothetical cases to refining their ability to apply U.S. law with precision and nuance. This is an opportunity to shape how AI systems learn to reason like attorneys — not just recall statutes — and directly influence the future of AI in the legal industry.

What Does a Typical Day Look Like?

You’ll work alongside top AI researchers and legal experts shaping foundational LLMs at leading AI labs to:

• Review and evaluate model outputs on complex U.S. legal hypotheticals across multiple domains of law.
• Apply a structured legal rubric to assess accuracy, relevance, logical reasoning, and application of law.
• Identify gaps, edge cases, and reasoning blind spots — helping define new benchmarks for legal understanding in AI.
• Provide clear, consistent annotations and detailed feedback that directly improve model fine-tuning and legal reasoning capabilities.

Required Skills & Experience

• Juris Doctor (J.D.) from an accredited U.S. law school, with active or inactive Bar admission.
• 3+ years of experience practicing law or teaching at a U.S.-based law school.
• Proven ability to apply U.S. legal reasoning to complex, nuanced cases (hypothetical or real-world).
• Strong foundational knowledge across multiple areas of U.S. law, including contracts, torts, criminal law, constitutional law, corporate law, and civil procedure.
• Exceptional attention to detail, precision, and consistency in evaluating and annotating legal work.
• Excellent written communication skills for delivering clear, high-quality feedback.
• High ethical standards and the ability to handle sensitive legal information with confidentiality.
• Interest in AI and language models (LLMs) is a plus.
• Commitment: Flexible engagement, minimum 10 hrs/week, up to 40 hrs/week.
• Type: Contractor (no medical/paid leave).
• Duration: 1 month with potential extensions based on performance and fit.

Application Details

After applying, you will receive an email with a login link. Please use that link to access the portal and complete your profile.

Know amazing talent? Refer them at turing.com/referrals, and earn money from your network.