AI & Law Research Scientist — Benchmarks & Evaluation

Connect Legal Partners

San Francisco (CA)

On-site

USD 185,000 - 250,000

Full time

5 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity

Job summary

Connect Legal Partners is seeking a dedicated ML researcher to design experiments that test how AI systems respond to legal rules and competing obligations. You will build evaluation environments, training pipelines and runtime controls, collaborating with legal specialists to ground research in practical legal scenarios.

The role includes publishing results and releasing benchmarks or tools for the community.

Qualifications

  • At least one year of research or ML engineering experience.
  • Strong Python and modern machine learning skills are required.
  • Evidence of work in AI safety, alignment or evaluation.
  • Legal training or experience assessing model-based judges would be useful.

Responsibilities

  • Design experiments to test how AI systems respond to legal rules and competing obligations.
  • Build evaluation environments, training pipelines and runtime controls.
  • Collaborate with legal specialists to ground research in practical legal situations.
  • Own projects through publication and release benchmarks or tools for others to use.

Skills

Python
Machine Learning
AI safety

Education

Bachelor's degree or higher in CS/ML/related field

Job description

Connect Legal Partners is seeking a dedicated ML researcher to design experiments that test how AI systems respond to legal rules and competing obligations. You will build evaluation environments, training pipelines and runtime controls, collaborating with legal specialists to ground research in practical legal scenarios.

The role includes publishing results and releasing benchmarks or tools for the community.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Legal AI Evaluation Architect (Remote)
Senior Legal AI Evaluation Architect (Remote)

24-Mag Llc • New York (NY)

Remote
USD 400,000 - 800,000
Health insurance
Paid time off
Retirement plan contributions
+1
Remote Legal AI Research Scientist - Benchmarks & Evaluation
Remote Legal AI Research Scientist - Benchmarks & Evaluation

Recruitment Room • United States

Remote
USD 200,000 - 250,000
Equity compensation eligibility
Performance-based bonus eligibility
Health insurance premium reimbursement
Head of Evaluations (Legal AI Benchmarking)
Head of Evaluations (Legal AI Benchmarking)

Newcode • United States

Remote
USD 120,000 - 180,000
Remote role
Global eligibility (US/UK/Norway)
GenAI Evaluation Scientist: LLM Benchmarks & Diagnostics
GenAI Evaluation Scientist: LLM Benchmarks & Diagnostics

Scale AI • San Francisco (CA)

On-site
USD 166,000 - 207,000
Health coverage
Equity
Retirement benefits
+3
Research Scientist, AI and Law
Research Scientist, AI and Law

Connect Legal Partners • San Francisco (CA)

On-site
USD 185,000 - 250,000
Equity
Remote Legal AI Researcher & Evaluation Architect
Remote Legal AI Researcher & Evaluation Architect

micro1 • United States

Remote
USD 200,000 - 250,000
Health insurance reimbursement
Paid time off
401(k) with company match
+1
GenAI Evaluation Scientist — Benchmark & Diagnose LLMs
GenAI Evaluation Scientist — Benchmark & Diagnose LLMs

Scale AI, Inc. • New York (NY)

On-site
USD 181,000 - 226,000
Base salary + equity
Health, dental, vision coverage
Retirement benefits
+3
Head of Evaluations (Legal AI Benchmarking)
Head of Evaluations (Legal AI Benchmarking)

Newcode.ai • New York (NY)

On-site
USD 120,000 - 190,000
ML Evaluation Scientist - LLM Benchmarks
ML Evaluation Scientist - LLM Benchmarks

Scale AI • Seattle (WA)

On-site
USD 181,000 - 226,000
Health coverage
Retirement benefits
L&D stipend
+2
Applied Legal Researcher →
Applied Legal Researcher →

Nextlex • San Francisco (CA)

On-site
USD 150,000 - 210,000