Remote Legal Assessment Architect: Question Authoring

Mercor; Greater London; On-site; GBP 13,000 - 27,000; Part time

Job summary

Mercor seeks legal experts to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core law domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

There are two task types: Question Authoring and Question Verification. You will rate difficulty, craft plausible distractors, and document changes with clarity.

Qualifications

• Original law questions testing deep conceptual understanding
• Questions must be clear, self-contained and well-defined
• Rate each question's difficulty: Medium/Hard/Expert
• Provide 1 correct answer and 9 plausible distractors
• Write step-by-step Chain-of-Thought solutions in markdown format
• Supply 1–5 academic references per question
• Flag issues for verification tasks with justification of edits

Responsibilities

• Author original law questions across listed domains
• Review pre-written questions for accuracy and clarity
• Rate difficulty per question
• Provide edits and justifications for verifications

Skills

Legal expertise

Academic writing

English proficiency

Education

JD or equivalent

LLM or doctoral candidate

Job description

Mercor seeks legal experts to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core law domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

There are two task types: Question Authoring and Question Verification. You will rate difficulty, craft plausible distractors, and document changes with clarity.