Remote AI Legal Evaluator & Rubric Architect (Attorney)

Consilio LLC; United States; Remote; USD 62,000 - 76,000; Full time

Benefits offered by this job

Remote work

Part-time hours

ASAP start

Job summary

Consilio LLC is seeking an AI Expert Contributor (Attorney) for a remote, part-time role in the United States. You will apply real attorney judgment to evaluate legal questions, refine rubrics, and ensure objective grading criteria for AI-generated legal work.

Responsibilities include reviewing legal queries, validating citations, and maintaining confidentiality while leveraging online legal research and AI tools. Start ASAP, approx. 10 hours/week for one month+ with pay at $45–$55/hour (W2).

Qualifications

• J.D. is required.
• 1–6 years practicing U.S. law.
• Ability to explain legal reasoning clearly and create objective grading criteria.
• Strong attention to citations, factual accuracy, consistency, and confidentiality.
• Comfort with online legal research, document, and AI tools/platforms.
• Licensing: any U.S. state.

Responsibilities

• Review legal queries and accompanying materials.
• Strengthen and refine scoring rubrics for consistent grading.
• Develop objective pass/fail criteria with clear reasoning.
• Validate citations, factual accuracy, document consistency, and confidentiality considerations.
• Work across online legal research, document, and AI platforms.

Skills

Legal reasoning

Citations

Confidentiality

Online legal research

Education

J.D.

Job description

Consilio LLC is seeking an AI Expert Contributor (Attorney) for a remote, part-time role in the United States. You will apply real attorney judgment to evaluate legal questions, refine rubrics, and ensure objective grading criteria for AI-generated legal work.

Responsibilities include reviewing legal queries, validating citations, and maintaining confidentiality while leveraging online legal research and AI tools. Start ASAP, approx. 10 hours/week for one month+ with pay at $45–$55/hour (W2).