Legal Expert – AI Training

CNTXT AI; United States; Remote; USD 55,000 - 103,000; Part time

Job summary

CNTXT AI in the United States is seeking a remote, hourly contractor to apply professional legal judgement to evaluate how advanced AI models reason through legal problems and to build cases testing that reasoning.

You will design questions, evaluate AI analyses, review documents, perform contract review and redlining, and assess regulatory scenarios with clear, citation-backed explanations. Strong law degree and English proficiency are required.

Qualifications

• Law degree and professional legal background.
• Strong written English and ability to explain complex legal concepts clearly.
• Attention to detail and discretion in handling sensitive material.

Responsibilities

• Designing legal questions, prompts, and evaluation sets grounded in real practice, including ambiguity and high-stakes decisions
• Evaluating AI-generated legal analysis for accuracy, reasoning quality, and citation support
• Reviewing and annotating legal documents against instructions, producing clear explanations
• Contract review and redlining with clause-level analysis and simulated negotiations
• Assessing AI performance on regulatory scenarios, obligations and enforcement contexts
• Rating and comparing AI responses using structured rubrics
• Flagging ambiguity and jurisdictional variation; quality-checking others' work

Skills

Legal reasoning

English proficiency

Attention to detail

Discretion

Remote work

Written communication

Education

Law degree (LLB, LLM, JD, or equivalent)

Job description

In this remote, hourly contractor role, you will apply professional legal judgement to evaluate how advanced AI models reason through legal problems, and build cases that test the limits of that…

In this remote, hourly contractor role, you will apply professional legal judgement to evaluate how advanced AI models reason through legal problems, and build cases that test the limits of that reasoning. Project scopes vary and may include:

• Designing legal questions, prompts, and evaluation sets grounded in real practice, including matters involving ambiguity, competing authorities, and high-stakes decisions
• Evaluating AI-generated legal analysis for accuracy, reasoning quality, and citation support, identifying misread authority, unsupported assumptions, misapplied rules, and unflagged legal risk
• Reviewing and annotating legal documents against detailed instructions, producing citation-backed determinations with clear plain-language explanations
• Contract review and redlining, including clause-level analysis and simulated negotiation exercises
• Assessing AI performance on compliance and regulatory scenarios, including regulatory obligations, disclosure requirements, and enforcement contexts
• Rating and comparing AI responses against structured rubrics, applied consistently across task types
• Flagging ambiguity and jurisdictional variation, and quality-checking the work of other reviewers

Profile Requirements

• Law degree (LLB, LLM, JD, or equivalent)
• Professional experience in legal practice, in-house counsel, compliance, regulatory affairs, or legal academia
• Strong command of legal reasoning: statutory interpretation, application of precedent, risk identification, and defensible argument construction
• Ability to explain complex legal concepts and corrections clearly and accurately in writing
• Full professional English proficiency
• Exceptional attention to detail
• Reliable and self-directed, with consistent output quality in a remote, asynchronous workflow
• Discretion and sound judgement with sensitive or proprietary material

Preferred Experience

• Admission to a bar or law society, or equivalent professional qualification, with jurisdiction stated
• Specialist practice area depth, for example corporate and M&A, intellectual property, tax, employment, data protection, litigation, or financial services regulation
• Prior experience with AI data training, annotation, or model evaluation

Application Notes

Projects vary in jurisdiction, practice area, and language, so please make the following explicit in your resume:

• Languages you work in, with proficiency level, and whether you handle legal terminology in each
• Degree details, including institution, jurisdiction of legal training, and specialisation
• Bar admission or professional qualification, including jurisdiction, year, and current status
• Practice areas and years of experience in each

Please kindly note that only qualified candidates will be contacted. Our team will reach out to you when a matching project opens.

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.