Senior Legal Specialist — AI Task Evaluation

Tech Faculty

United States

Remote

USD 136,000 - 194,000

Full time

4 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mercor is seeking practicing attorneys to build and review evaluation tasks for AI agents in a simulated firm or legal department.

You will ensure tasks read like real assignments, verify references, and refine rubrics; opportunities to advance to reviewer and world lead roles.

Ideal candidates have 3+ years of practice, a JD or international degree, US bar admission, and familiarity with multiple practice areas.

Qualifications

  • 3+ years of practice as an attorney.
  • Active bar admission (US preferred).
  • Major-firm or in-house experience is a plus, but time in practice matters more.
  • Experience on a Mercor RL project is a plus.

Responsibilities

  • Refine AI-drafted task prompts so they read like a real assignment from a partner, general counsel or client, without giving the answer away.
  • Check the reference answer against the world's files and the applicable law, and correct what is wrong.
  • Write and tighten grading rubrics: pass/fail criteria tied to specific facts and rules, plus the judgment calls a non-lawyer would miss.
  • Read how leading AI models attempt each task and confirm they fail for fair, defensible reasons.
  • Work in your own practice area. Current areas include corporate and M&A, commercial contracts, civil litigation and arbitration, employment, real estate, intellectual property, estate planning, family, criminal and appellate, administrative and regulatory, antitrust, privacy, securities, environmental, health, and insurance coverage.

Skills

Attorney experience
Bar admission
US bar admission preferred
Advocacy rights

Education

JD or international-equivalent law degree

Job description

Mercor is seeking practicing attorneys to build and review evaluation tasks for AI agents in a simulated firm or legal department.

You will ensure tasks read like real assignments, verify references, and refine rubrics; opportunities to advance to reviewer and world lead roles.

Ideal candidates have 3+ years of practice, a JD or international degree, US bar admission, and familiarity with multiple practice areas.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Law Expert
Law Expert

Tech Faculty • United States

Remote
USD 136,000 - 194,000
Legal AI Engagement Lead
Legal AI Engagement Lead

Mercor • San Francisco (CA)

On-site
USD 170,000 - 240,000
Performance bonus
Equity
Meals stipend
+7
Senior Legal AI Trainer & Evaluator (Bay Area)
Senior Legal AI Trainer & Evaluator (Bay Area)

Mercor • United States

Hybrid
USD 180,000 - 230,000
Senior Legal AI Trainer & Evaluation Expert (Bay Area)
Senior Legal AI Trainer & Evaluation Expert (Bay Area)

Mercor • San Francisco (CA)

Hybrid
USD 83,000 - 138,000
Referral reward up to $1,600
On-site work in Bay Area
Remote AI Legal Reviewer — Expert Counsel
Remote AI Legal Reviewer — Expert Counsel

Pearson • United States

Remote
USD 34,000 - 83,000
US Contract Attorney — Litigation Mercor
US Contract Attorney — Litigation Mercor

Aitrainergigs • United States

Remote
USD 120,000 - 180,000
Fully remote
Flexible hours
Global AI Legal Reviewer (Remote Contract)
Global AI Legal Reviewer (Remote Contract)

Mercor • San Francisco (CA)

Hybrid
GBP 103,000 - 144,000
Remote Legal Reviewer for AI & Compliance
Remote Legal Reviewer for AI & Compliance

Mercor • United States

Remote
USD 138,000 - 193,000
US Contract Attorney — In-House Counsel Mercor
US Contract Attorney — In-House Counsel Mercor

Aitrainergigs • United States

Remote
USD 120,000 - 210,000
Fully remote
Flexible hours
US Contract Attorney — Federal Litigation Mercor
US Contract Attorney — Federal Litigation Mercor

Aitrainergigs • United States

Remote
USD 83,000 - 124,000