Remote Legal Rubric & Ground-Truth Auditor (JD, 5+ yrs)

Benture

United States

Remote

USD 165,000 - 193,000

Part time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Mercor seeks experienced licensed attorneys to audit rubrics and ground-truth answers for a legal research dataset used to evaluate AI systems. You will verify model answers, refine grading rubrics, and ensure alignment with current law. This is a short-term, fully remote engagement, restricted to the United States.

The role requires JD, active U.S. bar admission, and 5+ years of legal practice across multiple areas such as administrative, business, civil, constitutional, criminal, family,

Qualifications

  • JD and active U.S. bar admission.
  • 5+ years of legal practice.
  • Substantive experience in at least one practice area.

Responsibilities

  • Audit grading rubrics for accuracy, completeness, consistency and clarity.
  • Verify ground-truth answers against controlling statutes, regulations and case law.
  • Identify legal errors, outdated authority, missing issues and ambiguous grading criteria.
  • Rewrite or correct ground-truth answers and rubric items where needed.
  • Provide concise, structured written feedback on each item reviewed.

Skills

Legal research
Legal writing
Attention to detail

Education

Juris Doctor (JD)

Job description

Mercor seeks experienced licensed attorneys to audit rubrics and ground-truth answers for a legal research dataset used to evaluate AI systems. You will verify model answers, refine grading rubrics, and ensure alignment with current law. This is a short-term, fully remote engagement, restricted to the United States.

The role requires JD, active U.S. bar admission, and 5+ years of legal practice across multiple areas such as administrative, business, civil, constitutional, criminal, family,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Legal Rubric & Ground-Truth Auditor
Remote Legal Rubric & Ground-Truth Auditor

Mercor • United States

Remote
USD 83,000 - 124,000
Legal Rubric & Ground Truth Auditor (Licensed Attorney)
Legal Rubric & Ground Truth Auditor (Licensed Attorney)

Mercor • United States

Remote
USD 83,000 - 124,000
Remote Legal Rubric Auditor — Licensed Attorney
Remote Legal Rubric Auditor — Licensed Attorney

Confidential • United States

Remote
USD 83,000 - 165,000
Legal Rubric & Ground Truth Auditor (Attorney) · Mercor Mercor · $120-140/hr · remote in US · 3d ago $120-140/hr remote in US 3d ago
Legal Rubric & Ground Truth Auditor (Attorney) · Mercor Mercor · $120-140/hr · remote in US · 3d ago $120-140/hr remote in US 3d ago

Benture • United States

Remote
USD 165,000 - 193,000
Legal Rubric & Ground Truth Auditor (Licensed Attorney)
Legal Rubric & Ground Truth Auditor (Licensed Attorney)

Confidential • United States

Remote
USD 83,000 - 165,000
Remote US Attorney Evaluator for AI Legal Tasks Rubrics
Remote US Attorney Evaluator for AI Legal Tasks Rubrics

Vettedlance • United States

Remote
USD 138,000 - 220,000
Remote AI Legal Evaluator & Rubric Architect (Attorney)
Remote AI Legal Evaluator & Rubric Architect (Attorney)

Consilio LLC • United States

Remote
USD 62,000 - 76,000
Remote work
Part-time hours
ASAP start
Remote Legal AI Quality Auditor
Remote Legal AI Quality Auditor

Mercor • Chicago (IL)

Remote
USD 96,000 - 152,000
Remote AI Legal Evaluator - Attorney (JD)
Remote AI Legal Evaluator - Attorney (JD)

Undisclosed • United States

Remote
USD 142,000 - 202,000
Remote Legal Expert: AI Model Evaluator in Employment Law
Remote Legal Expert: AI Model Evaluator in Employment Law

Intellerzone • United States

Remote
CAD 194,934 - 292,401