AI Expert Contributor

Consilio LLC; United States; Remote; USD 62,000 - 76,000; Full time

Benefits offered by this job

Remote work

Part-time hours

ASAP start

Job summary

Consilio LLC is seeking an AI Expert Contributor (Attorney) for a remote, part-time role in the United States. You will apply real attorney judgment to evaluate legal questions, refine rubrics, and ensure objective grading criteria for AI-generated legal work.

Responsibilities include reviewing legal queries, validating citations, and maintaining confidentiality while leveraging online legal research and AI tools. Start ASAP, approx. 10 hours/week for one month+ with pay at $45–$55/hour (W2).

Qualifications

• J.D. is required.
• 1–6 years practicing U.S. law.
• Ability to explain legal reasoning clearly and create objective grading criteria.
• Strong attention to citations, factual accuracy, consistency, and confidentiality.
• Comfort with online legal research, document, and AI tools/platforms.
• Licensing: any U.S. state.

Responsibilities

• Review legal queries and accompanying materials.
• Strengthen and refine scoring rubrics for consistent grading.
• Develop objective pass/fail criteria with clear reasoning.
• Validate citations, factual accuracy, document consistency, and confidentiality considerations.
• Work across online legal research, document, and AI platforms.

Skills

Legal reasoning

Citations

Confidentiality

Online legal research

Education

J.D.

Job description

AI Expert Contributor (Attorney) | Remote (U.S.)

Help shape how legal AI is evaluated—by bringing real attorney judgment to realistic legal questions. On this projectyou’ll help ensure evaluation rubrics are clear, objective, and strong enough to grade AI-generated legal responses against attorney-quality standards.

Overview

This is a remote opportunity for attorneys who enjoy precise legal reasoning, clean issue-spotting, and translating judgment into practical grading criteria. You’ll work on legal queries (with supporting documents where applicable), task metadata, and rubrics (“Answer Points”) used to score final answers.

What You’ll Do

• Review legal queries and the accompanying materials (when provided).
• Strengthen and refine scoring rubrics so they clearly guide consistent grading.
• Develop objective pass/fail criteria and ensure reasoning is explained clearly.
• Validate citations, factual accuracy, document consistency, and confidentiality considerations.
• Work comfortably across online legal research, document, and AI platforms.

Must-Have Qualifications

• J.D.
• 1–6 years practicing U.S. law
• Ability to explain legal reasoning clearly and create objective grading criteria
• Strong attention to citations, factual accuracy, consistency, and confidentiality
• Comfort working with online legal research, document, and AI tools/platforms
• Licensing: any U.S. state

Nice-to-Have

• Passed a bar exam and currently licensed in the U.S.
• Familiarity evaluating AI-generated legal work
• Experience across more than one practice area or jurisdiction

Schedule, Duration, and Pay

• Remote
• Start: ASAP
• Hours: ~10 hours/week (with potential to take on more tasks)
• Duration: one month+
• Pay: $45–$55/hour (W2)

Bring your legal judgment to the next generation of legal AI—.