Legal Domain Expert — AI Training & Evaluation

Mercor

San Francisco (CA)

Hybrid

USD 83,000 - 138,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Referral reward up to $1,600
On-site work in Bay Area

Job summary

Mercor is seeking a senior legal domain expert to collaborate with a leading AI lab's research and program management teams to improve how frontier AI models reason about real legal work. You will review the quality of legal knowledge tasks, write instruction specifications and golden solutions, and help build benchmarks that demonstrate genuine model improvement.

This is a full-time W-2 role with Cincinnatus LLC, based in the Bay Area, California.

Qualifications

  • JD from an accredited law school.
  • 5+ years of substantive post-qualification legal practice at a reputable institution.
  • Genuine specialization in at least one substantive practice area (e.g., corporate, litigation, regulatory, IP, employment, tax).
  • Active admission to at least one U.S. state bar, in good standing.
  • Hands-on experience with large language models in professional work; ability to judge a well-reasoned answer from a plausible-sounding wrong one.
  • Able to commit reliably to 40 hours per week for an initial engagement of 6 months.
  • Living in the Bay Area, California, and able to work on-site with the client's team multiple days per week.

Responsibilities

  • Data QA and reviews: Vet the quality of legal knowledge work tasks and model outputs; spot gaps and weak reasoning.
  • Write instruction specs and golden datasets to define correct solutions for legal problems.
  • Design benchmarks and domain-specific evaluation sets with the research team.
  • Calibrate standards with client researchers and translate tacit legal judgment into explicit criteria.

Education

Juris Doctor (JD) from an accredited law school

Job description

Legal Domain Expert — AI Training & Evaluation

Company: Mercor

Compensation: $60-$100 per hour

Commitment: Full-time position

Location: Bay Area, CA

Referral Reward: Earn up to $1,600 per successful referral.

Referral Link: https://t.mercor.com/FVtcC

Location requirements: United States

Overview

We are hiring a senior legal domain expert to work directly with a leading AI lab's research and program management teams, improving how frontier AI models reason about real legal work. Your legal expertise is the substance of this role. You will review the quality of legal knowledge work tasks, write the instruction specs and golden solutions that define what "correct" looks like, and build the benchmarks that show whether the model is genuinely improving. We are looking for a practising specialist rather than a generalist. This is a full-time W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI lab as part of their extended workforce. You will be provisioned with client-issued accounts and equipment, and will work inside the client's own tools alongside their research teams. Location: This is a hybrid role based in the Bay Area, California. You must live in the Bay Area and work on-site with the client's team multiple days each week, when required. This is not a remote role. If you do not currently live in the Bay Area, you must be willing to relocate there at your own cost before the engagement starts - relocation assistance is not provided.

Key Responsibilities
  • Data QA and reviews: Vet the quality of legal knowledge work tasks and model outputs - spotting missing behaviors, thin reasoning, and answers that read well but would not survive professional scrutiny.
  • Instruction specs and golden datasets: Write high-quality instruction specs, produce golden solutions to legal problems, and define new legal tasks that reflect how the work is actually done in practice.
  • Benchmarks and domain depth: Design challenging legal tasks and evaluation sets, and help build legal-specific skills and tools together with the research team.
  • Calibration: Work with client researchers and specialists in adjacent fields to keep standards consistent, translating tacit legal judgment into explicit, teachable criteria.
Core Qualifications
  • Education: Juris Doctor (JD) from an accredited law school; a highly ranked school is strongly preferred.
  • Experience: 5+ years of substantive post-qualification legal practice at a reputable institution - an established law firm, a corporate legal department, a regulatory body, or a court. Internships and clerkships alone do not count.
  • Domain depth: Genuine specialization in at least one substantive practice area, for example corporate and transactional, litigation and dispute resolution, regulatory and compliance, intellectual property, employment and labor, or tax.
  • Seniority: Clear progression to a senior level - partner, of counsel, counsel, senior associate, senior in-house counsel, or general counsel - with real ownership of matters.
  • Licensure: Active admission to at least one U.S. state bar, in good standing.
  • AI fluency: Hands-on working use of large language models in your professional work, and the judgment to tell a well-reasoned answer from a plausible-sounding wrong one.
  • Availability: Able to commit reliably to 40 hours per week for an initial engagement of 6 months.
  • Location: Living in the Bay Area, California, and able to work on-site with the client's team multiple days each week, when required. Candidates not currently based in the Bay Area must be willing to relocate there at their own cost; relocation assistance is not provided.
  • Excellent written communication, and the ability to give precise, well-structured written feedback.
About Cincinnatus LLC

Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for contingent and contract-based opportunities. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives. Roles hired through Cincinnatus are not project-based or freelance engagements. They are structured, role-based positions that typically involve part-time or full-time commitments, close collaboration with a client's internal teams, and integration into standard enterprise workflows.

Cincinnatus is a legal entity separate from Mercor. While opportunities may be discovered through Mercor's platform, employment, onboarding, payroll, and benefits for these roles are administered by Cincinnatus LLC.

Equal Employment Opportunity

Cincinnatus is proud to be an Equal Employment Opportunity employer.

We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic.

Cincinnatus is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans throughout the job application process.

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Partner & General Counsel - Legal Domain Expert
Partner & General Counsel - Legal Domain Expert

Mercor • San Francisco (CA)

Hybrid
USD 138,000 - 207,000
Referral reward program
Senior Counsel — Legal Domain Expert
Senior Counsel — Legal Domain Expert

Mercor • San Francisco (CA)

On-site
USD 117,000 - 165,000
Legal Domain Expert — AI Training & Evaluation
Legal Domain Expert — AI Training & Evaluation

Mercor • United States

Hybrid
USD 180,000 - 230,000
Senior Counsel — Legal Domain Expert
Senior Counsel — Legal Domain Expert

Mercor • United States

Hybrid
USD 117,000 - 165,000
Partner & General Counsel - Legal Domain Expert
Partner & General Counsel - Legal Domain Expert

Mercor • United States

Hybrid
USD 138,000 - 207,000
Engineering & Software Domain Expert
Engineering & Software Domain Expert

Mercor • San Francisco (CA)

On-site
USD 90,000 - 145,000
Legal GTM Associate
Legal GTM Associate

Mercor • San Francisco (CA)

On-site
USD 85,000 - 120,000
Bi-annual performance bonus structure
Generous equity grant vested over 4 y
Up to $15k Relocation bonus
+6
Private Equity & Venture Capital - Finance Domain Expert
Private Equity & Venture Capital - Finance Domain Expert

Mercor • San Francisco (CA)

On-site
USD 152,000 - 207,000
Senior Legal AI Trainer & Evaluator (Bay Area)
Senior Legal AI Trainer & Evaluator (Bay Area)

Mercor • United States

Hybrid
USD 180,000 - 230,000
Senior Legal AI Trainer & Evaluation Expert (Bay Area)
Senior Legal AI Trainer & Evaluation Expert (Bay Area)

Mercor • San Francisco (CA)

Hybrid
USD 83,000 - 138,000
Referral reward up to $1,600
On-site work in Bay Area