Remote Legal & Compliance Rubric Designer (Contract)

SuperAnnotate AI, Inc.; United States; Remote; USD 152,000 - 179,000; Part time

Job summary

SME Careers in the United States seeks an hourly contractor to serve as a Legal & Compliance SME. You will craft challenging professional scenarios, write rubrics, and evaluate AI-driven legal outputs with rigorous standards.

Requirements include a JD/LLB/LLM or equivalent, 3+ years in law or compliance, and strong English (C1). You will help train AI models while maintaining professional judgment and risk awareness.

Qualifications

• JD, LLB, LLM, or equivalent in law or compliance.
• Strong English proficiency at C1+.
• 3+ years in law, regulatory compliance, or related fields.
• Experience with AI evaluation or rubric-based scoring preferred.

Responsibilities

• Create legal and compliance tasks requiring expert analysis.
• Design detailed rubrics covering issues, standards, and risks.
• Evaluate AI-generated analyses for accuracy and rigor.
• Review issue spotting for material considerations.
• Assess reasoning quality and identify unsupported conclusions.
• Develop reference content and gold-standard examples.
• Support AI training with questions and evaluation data.

Skills

Law

Legal Analysis

Compliance

Regulatory Compliance

Privacy

Contracts

AI Evaluation

Rubric Design

Issue Spotting

Model Evaluation

Legal Reasoning

Expert Review

English

Education

JD / LLB / LLM

Job description

SME Careers in the United States seeks an hourly contractor to serve as a Legal & Compliance SME. You will craft challenging professional scenarios, write rubrics, and evaluate AI-driven legal outputs with rigorous standards.

Requirements include a JD/LLB/LLM or equivalent, 3+ years in law or compliance, and strong English (C1). You will help train AI models while maintaining professional judgment and risk awareness.