Remote Legal Expert - 42119

Turing; Toronto; On-site; CAD 112,243 - 224,487; Part time

Job summary

Turing is seeking a contractor to evaluate and annotate AI models for legal reasoning, requiring a Juris Doctor degree and 3+ years of legal experience. The role involves reviewing U.S. legal hypotheticals, applying legal standards, and providing detailed feedback. This flexible position offers 10-40 hours per week for a duration of 1 month, with extensions possible based on performance. Join Turing to help shape the future of AI in the legal field.

Qualifications

• 3+ years of experience practicing law or teaching at a U.S.-based law school.
• Proven ability to handle complex, nuanced legal cases.
• Interest in AI and language models (LLMs) is a plus.

Responsibilities

• Review and evaluate model outputs on complex U.S. legal hypotheticals.
• Apply a structured legal rubric for accuracy and relevance.
• Provide consistent annotations and feedback to improve model fine-tuning.

Skills

U.S. legal reasoning

Attention to detail

Written communication

Multidisciplinary legal knowledge

Education

Juris Doctor (J.D.) from an accredited U.S. law school

Job description

Turing is one of the world’s fastest-growing AI companies, pushing the boundaries of AI-assisted software development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software repositories. You’ll be working at the intersection of software engineering, open-source ecosystems, and frontier AI.

Project Overview

We’re advancing the frontier of AI by training large language models to think like skilled legal professionals. Our goal is to build high-quality evaluation and training datasets that capture the real reasoning challenges lawyers and legal scholars face.

You’ll work on ambitious, high-impact projects within the legal domain: from evaluating how models handle complex hypothetical cases to refining their ability to apply U.S. law with precision and nuance. This is an opportunity to shape how AI systems learn to reason like attorneys — not just recall statutes — and directly influence the future of AI in the legal industry.

Role Overview — What Does a Typical Day Look Like?

• Review and evaluate model outputs on complex U.S. legal hypotheticals across multiple domains of law.
• Apply a structured legal rubric to assess accuracy, relevance, logical reasoning, and application of law.
• Identify gaps, edge cases, and reasoning blind spots — helping define new benchmarks for legal understanding in AI.
• Provide clear, consistent annotations and detailed feedback that directly improve model fine-tuning and legal reasoning capabilities.

Required Skills & Experience

• Juris Doctor (J.D.) from an accredited U.S. law school, with active or inactive Bar admission.
• 3+ years of experience practicing law or teaching at a U.S.-based law school.
• Proven ability to apply U.S. legal reasoning to complex, nuanced cases (hypothetical or real-world).
• Strong foundational knowledge across multiple areas of U.S. law, including contracts, torts, criminal law, constitutional law, corporate law, and civil procedure.
• Exceptional attention to detail, precision, and consistency in evaluating and annotating legal work.
• Excellent written communication skills for delivering clear, high-quality feedback.
• High ethical standards and the ability to handle sensitive legal information with confidentiality.
• Interest in AI and language models (LLMs) is a plus.
• Commitment: Flexible engagement, minimum 10 hrs/week, up to 40 hrs/week.
• Type: Contractor (no medical/paid leave).
• Duration: 1 month with potential extensions based on performance and fit.