Remote Legal AI Research Scientist - Benchmarks & Evaluation

Appsierra Group; United States; On-site; USD 200,000 - 250,000; Full time

Benefits offered by this job

Equity compensation eligibility

Performance-based bonus eligibility

Health insurance premium reimbursement

Job summary

Appsierra Group is seeking a Member of Technical Staff, Legal Research to advance AI-driven legal evaluation. You will design evaluation frameworks, curate datasets, and collaborate with researchers to improve legal reasoning in AI systems.

The role emphasizes interdisciplinary work across law, AI, and policy, with a base salary in the advertised range and remote work flexibility. You will publish findings, contribute to benchmarks, and help shape standardized approaches to legal AI evaluation.

Qualifications

• Advanced degree in law (JD/LLM/SJD/PhD) or equivalent.
• Deep expertise in corporate law, contracts, litigation, regulatory compliance, IP, employment law, or public policy.
• Proven experience in legal research, legal analysis, or policy research.
• Experience developing structured methodologies for assessing legal arguments or research quality.

Responsibilities

• Design, develop, and maintain evaluation frameworks for AI agents operating in legal domains.
• Build benchmark suites, scoring methodologies, quality rubrics, and research-grade evaluation protocols.
• Conduct original research into legal reasoning, statutory interpretation, legal analysis, and workflow automation.
• Develop and curate datasets, case studies, and benchmark environments reflecting real-world legal challenges.
• Collaborate with AI researchers and engineers to evaluate and improve legal-focused models and agentic systems.
• Analyze model performance, reasoning quality, and failure modes across legal use cases.
• Document research findings, best practices, and evaluation methodologies.
• Monitor developments in legal technology, jurisprudence, regulatory environments, and AI research.
• Contribute to standards and frameworks for legal AI evaluation and benchmarking.

Skills

Legal research

AI benchmarking

Analytical reasoning

Education

JD/LLM/SJD/PhD in Law

Tools

Research methods

Job description

Appsierra Group is seeking a Member of Technical Staff, Legal Research to advance AI-driven legal evaluation. You will design evaluation frameworks, curate datasets, and collaborate with researchers to improve legal reasoning in AI systems.

The role emphasizes interdisciplinary work across law, AI, and policy, with a base salary in the advertised range and remote work flexibility. You will publish findings, contribute to benchmarks, and help shape standardized approaches to legal AI evaluation.