Remote Law Content Author for AI Assessment & Benchmarks

Obsidian; New York (NY); Remote; USD 60,000 - 90,000; Part time

Benefits offered by this job

Fully remote

Asynchronous work

10+ hours/week

Job summary

Obsidian seeks legal experts to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core law domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: question authoring or question verification, with responsibilities including rating difficulty and providing precise edits as needed.

Qualifications

• Proven ability to write rigorous, self-contained questions with clear problem statements.
• Experience in academic or bar-exam style writing is highly regarded.
• Ability to rate difficulty and provide precise justifications for edits.

Responsibilities

• Author original law questions that test deep conceptual understanding.
• Rate difficulty levels: Medium, Hard, or Expert.
• Provide 1 correct answer and 9 plausible distractors.
• Write step-by-step Chain-of-Thought solutions with clear reasoning.

Skills

Legal research

Academic writing

Question design

Quality review

Attention to detail

Critical thinking

Education

Juris Doctor (JD)

LLM or SJD (preferred)

Tools

Westlaw/Lexis

Job description

Obsidian seeks legal experts to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core law domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types: question authoring or question verification, with responsibilities including rating difficulty and providing precise edits as needed.