AI Legal Domain Expert — Training & Evaluation

Weekday 1; California City (CA); Hybrid; USD 83,000 - 138,000; Full time

Job summary

A leading AI research organization in the Bay Area seeks a Legal Domain Expert to advance how AI models perform professional legal tasks. You will evaluate AI outputs, develop high-quality reference solutions, and establish benchmarks that define accurate legal work in practice.

Candidates must have a JD, 5+ years of post-qualification experience, U.S. bar admission, and strong AI fluency. The role is hybrid in the Bay Area with a six-month initial engagement and 40 hours per week.

Qualifications

• JD from an accredited law school; education from a highly regarded institution is strongly preferred.
• 5+ years of substantive post-qualification legal experience at a law firm, corporate legal department, regulatory organization, court, or comparable institution.
• Active admission to at least one U.S. state bar and in good standing.
• Practical familiarity with large language models and AI tools, and ability to distinguish sound legal reasoning from plausible but inaccurate AI outputs.

Responsibilities

• Review legal tasks and AI-generated outputs for accuracy, completeness, reasoning quality, and professional relevance.
• Develop instructions and reference solutions for legal scenarios and benchmarks.
• Build evaluation benchmarks to measure AI capabilities across legal domains.
• Translate professional legal judgement into clear, structured evaluation criteria.
• Collaborate with AI researchers, program managers, and subject-matter experts to improve legal reasoning capabilities.
• Provide precise written feedback explaining why responses meet or fail to meet professional standards.

Skills

AI Fluency

Communication

Availability 40h

Education

Juris Doctor (JD)

Job description

A leading AI research organization in the Bay Area seeks a Legal Domain Expert to advance how AI models perform professional legal tasks. You will evaluate AI outputs, develop high-quality reference solutions, and establish benchmarks that define accurate legal work in practice.

Candidates must have a JD, 5+ years of post-qualification experience, U.S. bar admission, and strong AI fluency. The role is hybrid in the Bay Area with a six-month initial engagement and 40 hours per week.