Remote Law Assessment Architect for AI Benchmarks

Mercor; Greater London; Remote; GBP 55,000 - 96,000; Part time

Job summary

Mercor seeks legal experts to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core law domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

There are two task types: authoring original questions and verifying pre-written questions. The role is fully remote, asynchronous, with an expected commitment of 10+ hours per week.

Qualifications

• JD, LLM, or doctoral candidate in Law.
• Master's degree considered for exceptional depth in a subdomain.
• Strong command of legal reasoning and statutory interpretation.
• Experience with legal academia or bar exam writing is a plus.

Responsibilities

• Author original law questions that test deep conceptual understanding.
• Ensure questions are unambiguous, self-contained, and precisely defined.
• Rate each question's difficulty: Medium, Hard, or Expert.
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
• Write step-by-step Chain-of-Thought solutions with concise reasoning.
• Supply 1–5 academic references per question.
• For verification tasks: flag clarity and edits and justify changes.

Skills

Legal reasoning

Statutory interpretation

Jurisprudential theory

Academic writing

Education

JD/LLM/doctoral candidate in Law

Master's degree in a law-related field (considered)

Job description

Mercor seeks legal experts to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core law domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

There are two task types: authoring original questions and verifying pre-written questions. The role is fully remote, asynchronous, with an expected commitment of 10+ hours per week.