Senior Legal AI Benchmark Architect

DigiNo; Northern (KY); Hybrid; USD 180,000 - 240,000; Full time

Job summary

Cincinnatus LLC is recruiting a senior legal domain expert to work with a leading AI lab on how frontier AI models reason about real legal work. You will review quality, write instruction specs, and build benchmarks as part of a hybrid Bay Area engagement.

The role requires a JD from a reputable school, 5+ years of post‑qualification experience, active bar admission, and strong AI fluency for hands‑on model work.

Qualifications

• AI fluency demonstrated in professional work with large language models.
• Excellent written communication and ability to give precise feedback.
• Active admission to at least one U.S. state bar in good standing.
• Availability for 40 hours per week for an initial 6‑month engagement.

Responsibilities

• Data QA and reviews of legal knowledge tasks and model outputs.
• Write instruction specs and golden solutions for legal problems.
• Design legal benchmarks and evaluation sets with domain depth.
• Calibrate standards with client researchers and translate tacit judgments into explicit criteria.

Skills

AI fluency

Excellent writing

Education

JD (Law)

Job description

Cincinnatus LLC is recruiting a senior legal domain expert to work with a leading AI lab on how frontier AI models reason about real legal work. You will review quality, write instruction specs, and build benchmarks as part of a hybrid Bay Area engagement.

The role requires a JD from a reputable school, 5+ years of post‑qualification experience, active bar admission, and strong AI fluency for hands‑on model work.