Remote AI Legal Auditor & Case Builder

CNTXT AI

United States

Remote

USD 55,000 - 103,000

Part time

12 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

CNTXT AI in the United States is seeking a remote, hourly contractor to apply professional legal judgement to evaluate how advanced AI models reason through legal problems and to build cases testing that reasoning.

You will design questions, evaluate AI analyses, review documents, perform contract review and redlining, and assess regulatory scenarios with clear, citation-backed explanations. Strong law degree and English proficiency are required.

Qualifications

  • Law degree and professional legal background.
  • Strong written English and ability to explain complex legal concepts clearly.
  • Attention to detail and discretion in handling sensitive material.

Responsibilities

  • Designing legal questions, prompts, and evaluation sets grounded in real practice, including ambiguity and high-stakes decisions
  • Evaluating AI-generated legal analysis for accuracy, reasoning quality, and citation support
  • Reviewing and annotating legal documents against instructions, producing clear explanations
  • Contract review and redlining with clause-level analysis and simulated negotiations
  • Assessing AI performance on regulatory scenarios, obligations and enforcement contexts
  • Rating and comparing AI responses using structured rubrics
  • Flagging ambiguity and jurisdictional variation; quality-checking others' work

Skills

Legal reasoning
English proficiency
Attention to detail
Discretion
Remote work
Written communication

Education

Law degree (LLB, LLM, JD, or equivalent)

Job description

CNTXT AI in the United States is seeking a remote, hourly contractor to apply professional legal judgement to evaluate how advanced AI models reason through legal problems and to build cases testing that reasoning.

You will design questions, evaluate AI analyses, review documents, perform contract review and redlining, and assess regulatory scenarios with clear, citation-backed explanations. Strong law degree and English proficiency are required.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Legal Expert – AI Training
Legal Expert – AI Training

CNTXT AI • United States

Remote
USD 55,000 - 103,000
Remote Attorney Specialist: AI Trainer for Legal Reasoning
Remote Attorney Specialist: AI Trainer for Legal Reasoning

agency • United States

Remote
USD 69,000 - 103,000
Remote AI Legal Reviewer (Contractor)
Remote AI Legal Reviewer (Contractor)

Weekday AI • United States

Remote
USD 138,000 - 234,000
Remote AI Legal Analyst - Contract Trainer
Remote AI Legal Analyst - Contract Trainer

DataAnnotation • New York (NY)

Remote
USD 69,000 - 83,000
Remote AI Legal Reasoning Analyst
Remote AI Legal Reasoning Analyst

AfterQuery Experts • Miami (FL)

Remote
USD 103,000 - 276,000
Competitive hourly rate
Remote work
Flexible engagement
Remote Contractor Lawyer for AI Legal Review
Remote Contractor Lawyer for AI Legal Review

YO AI Labs • New York (NY)

Remote
USD 100,000 - 160,000
Remote Legal AI Evaluator & Reasoning Auditor
Remote Legal AI Evaluator & Reasoning Auditor

OpenTrain AI, Inc. • United States

Remote
USD 138,000 - 234,000
Remote Legal AI Trainer - Senior Attorney Expert
Remote Legal AI Trainer - Senior Attorney Expert

Remote • San Francisco (CA)

Remote
USD 69,000 - 103,000
Contractor: AI Legal Reasoning Annotator
Contractor: AI Legal Reasoning Annotator

Turing • Pittsburgh

Remote
USD 68,880 - 96,432
Contractor: AI Legal Reasoning Annotator
Contractor: AI Legal Reasoning Annotator

Turing • Seattle (WA)

Remote
USD 83,000 - 124,000