Remote Law Assessment & Benchmark Specialist

mercor; Canada; À distance; CAD 163 000 - 206 000; Temps partiel

Résumé du poste

Mercor connects elite creative and technical talent with leading AI research labs. We are seeking an Applied Legal Benchmark Specialist for a remote contract engagement, offering $83–$105 per hour. The role requires strong legal reasoning and the ability to craft precise questions and evaluation criteria.

Responsibilities include authoring test questions, ensuring clarity and self-containment, rating difficulty, providing correct answers with plausible distractors, and citing multiple references.

Qualifications

• Must have: JD, LLM, SJD, or doctoral candidate in Law or a closely related field.
• Master's degree considered for exceptional depth.
• Strong command of legal reasoning, statutory interpretation, and jurisprudential theory.
• Excellent written English and ability to express complex legal ideas clearly and concisely.

Responsabilités

• Author original law questions to test deep conceptual understanding, not surface-level recall.
• Ensure questions are unambiguous, self-contained, and precisely defined with all necessary information in the problem statement.
• Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above).
• Provide 1 correct answer and 9 plausible but subtly incorrect alternatives to challenge expert-level solvers.
• Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
• Supply 1–5 academic references per question from reputable sources.
• For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made.

Connaissances

Legal reasoning

Statutory interpretation

Jurisprudential theory

Formation

JD

LLM

SJD

Doctoral candidate

Master's degree considered

Description du poste

Mercor connects elite creative and technical talent with leading AI research labs. We are seeking an Applied Legal Benchmark Specialist for a remote contract engagement, offering $83–$105 per hour. The role requires strong legal reasoning and the ability to craft precise questions and evaluation criteria.

Responsibilities include authoring test questions, ensuring clarity and self-containment, rating difficulty, providing correct answers with plausible distractors, and citing multiple references.