Remote Legal Rubric & Ground-Truth Auditor

Mercor

United States

Remote

USD 83,000 - 124,000

Part time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Mercor is seeking experienced licensed attorneys to audit rubrics and ground-truth answers for a legal research dataset used to evaluate advanced AI systems. This is a short-term, fully remote engagement.

You will review existing legal research questions, verify the accuracy of model answers, and refine grading rubrics so the dataset reflects current law and sound legal reasoning. Strong research and writing skills are essential.

Qualifications

  • Juris Doctor (JD) and active U.S. bar admission in good standing.
  • 5+ years of legal practice.
  • Substantive experience in at least one listed practice area.
  • Strong legal research, analysis, and writing skills.

Responsibilities

  • Audit rubrics for accuracy, completeness, consistency, and clarity.
  • Verify ground-truth answers against controlling statutes, regulations, and case law.
  • Rewrite or correct ground-truth answers and rubric items where needed.
  • Provide concise, structured written feedback on each item reviewed.

Skills

Legal research
Legal writing
Analytical reasoning
Attention to detail

Education

Juris Doctor (JD)

Job description

Mercor is seeking experienced licensed attorneys to audit rubrics and ground-truth answers for a legal research dataset used to evaluate advanced AI systems. This is a short-term, fully remote engagement.

You will review existing legal research questions, verify the accuracy of model answers, and refine grading rubrics so the dataset reflects current law and sound legal reasoning. Strong research and writing skills are essential.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Legal Rubric & Ground-Truth Auditor (JD, 5+ yrs)
Remote Legal Rubric & Ground-Truth Auditor (JD, 5+ yrs)

Benture • United States

Remote
USD 165,000 - 193,000
Remote Legal Rubric Auditor — Licensed Attorney
Remote Legal Rubric Auditor — Licensed Attorney

Confidential • United States

Remote
USD 83,000 - 165,000
Legal Rubric & Ground Truth Auditor (Licensed Attorney)
Legal Rubric & Ground Truth Auditor (Licensed Attorney)

Mercor • United States

Remote
USD 83,000 - 124,000
Legal Rubric & Ground Truth Auditor (Attorney) · Mercor Mercor · $120-140/hr · remote in US · 3d ago $120-140/hr remote in US 3d ago
Legal Rubric & Ground Truth Auditor (Attorney) · Mercor Mercor · $120-140/hr · remote in US · 3d ago $120-140/hr remote in US 3d ago

Benture • United States

Remote
USD 165,000 - 193,000
Legal Rubric & Ground Truth Auditor (Licensed Attorney)
Legal Rubric & Ground Truth Auditor (Licensed Attorney)

Confidential • United States

Remote
USD 83,000 - 165,000
Remote US Attorney Evaluator for AI Legal Tasks Rubrics
Remote US Attorney Evaluator for AI Legal Tasks Rubrics

Vettedlance • United States

Remote
USD 138,000 - 220,000
Remote Legal AI Quality Auditor
Remote Legal AI Quality Auditor

Mercor • Chicago (IL)

Remote
USD 96,000 - 152,000
Remote AI Legal Evaluator & Rubric Architect (Attorney)
Remote AI Legal Evaluator & Rubric Architect (Attorney)

Consilio LLC • United States

Remote
USD 62,000 - 76,000
Remote work
Part-time hours
ASAP start
Remote Legal Reviewer for AI & Compliance
Remote Legal Reviewer for AI & Compliance

Mercor • United States

Remote
USD 138,000 - 193,000
Remote Legal Expert: AI Model Evaluator in Employment Law
Remote Legal Expert: AI Model Evaluator in Employment Law

Intellerzone • United States

Remote
CAD 194,934 - 292,401