Senior Legal AI Prompt Engineer and Evaluator

Thomson Reuters 

Eagan, Frisco, New York (MN, TX, NY)

Hybrid

USD 120,000 - 222,000

Full time

13 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Hybrid work model
Career development and growth
Mental health days off

Job summary

Thomson Reuters seeks a Sr. Legal AI Prompter / Evaluator to advance CoCounsel Legal through prompts, skills, and agent configurations. You will experiment with Thomson and other LLMs, build evaluation schemes, and ensure outputs are accurate and legally sound.

You will partner with SMEs, software engineers, and data scientists to improve product quality. The ideal candidate is an experienced lawyer with a passion for technology, comfortable with AI risk assessment, and capable of translating

Qualifications

  • Juris Doctor degree and bar admission in a US or Canadian jurisdiction.
  • 5-7 years of combined experience, including 2-3 years legal practice and collaboration with AI/tech teams.
  • Proven experience with generative AI, prompt engineering, and evaluating model outputs, plus coding in Python.

Responsibilities

  • Create, test, and refine prompts, skills, and agent configurations for CoCounsel Legal.
  • Experiment with Thomson and other LLMs to compare results and guide model selection.
  • Build datasets with SMEs and design evaluation schemes with rubrics and metrics.
  • Write and run scripts, experiments, and automated tests ensuring quality over large datasets.
  • Monitor production performance and identify failure modes in prompting, tooling, or retrieval.
  • Collaborate with engineers and data scientists to integrate LLMs into multi-step systems.
  • Engage with legal professionals to gather insights and stay current on legal tech developments.
  • Mentor colleagues and draft best-practice guidance for using LLMs.

Skills

Juris Doctor
Bar admission (US/Canada)
5-7 years total exp
Python & Git
Legal/AI experience

Education

Juris Doctor degree

Tools

OpenAI API
Anthropic API
Gemini API
LLM APIs

Job description

Thomson Reuters seeks a Sr. Legal AI Prompter / Evaluator to advance CoCounsel Legal through prompts, skills, and agent configurations. You will experiment with Thomson and other LLMs, build evaluation schemes, and ensure outputs are accurate and legally sound.

You will partner with SMEs, software engineers, and data scientists to improve product quality. The ideal candidate is an experienced lawyer with a passion for technology, comfortable with AI risk assessment, and capable of translating

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Legal AI Prompt Engineer & Evaluator
Senior Legal AI Prompt Engineer & Evaluator

USA018 Thomson Reuters Holdings Inc. • Eagan (MN)

Hybrid
USD 120,000 - 222,000
Hybrid Work Model
Flex My Way
Career Development
+2
Senior Legal AI Prompt Engineer & Evaluator
Senior Legal AI Prompt Engineer & Evaluator

Thomson Reuters • Eagan (MN)

Hybrid
USD 120,000 - 222,000
Hybrid Work Model
Flexible vacation
Mental Health Days
+3
Senior Legal AI Prompting & Evaluation Lead
Senior Legal AI Prompting & Evaluation Lead

Thomson Reuters • Frisco (TX)

Hybrid
USD 120,000 - 222,000
Hybrid work model
Career development opportunities
Mental health days
+3
Senior Legal AI Prompter & Evaluator (Hybrid)
Senior Legal AI Prompter & Evaluator (Hybrid)

Thomson Reuters • New York (NY)

Hybrid
USD 120,000 - 222,000
Hybrid work model
Mental health days
Tuition reimbursement
+2
Senior Software Engineer, Legal AI (Hybrid)
Senior Software Engineer, Legal AI (Hybrid)

Thomson Reuters  • Frisco (TX), New York (NY), Eagan (MN)

Hybrid
USD 102,000 - 190,000
Hybrid Work Model
Flexibility & Work-Life Balance
Career Development and Growth
+1
Senior AI Software Engineer - LegalTech Platform
Senior AI Software Engineer - LegalTech Platform

TRSS • Ann Arbor (MI)

Hybrid
USD 118,000 - 220,000
Hybrid Work Model
Career Growth
Competitive Benefits
+2
Senior Software Engineer (Legal AI) — Hybrid
Senior Software Engineer (Legal AI) — Hybrid

FDE Times • Frisco (TX)

Hybrid
USD 102,000 - 190,000
Hybrid work model
Flexible benefits
Career development
+1
Senior Software Engineer, Legal AI Solutions
Senior Software Engineer, Legal AI Solutions

Thomsonreuters • United States

Hybrid
USD 102,000 - 190,000
Hybrid work model
Two mental health days off
Tuition reimbursement
+1
Senior Software Engineer - Legal AI & Cloud-Native
Senior Software Engineer - Legal AI & Cloud-Native

CAN002 Thomson Reuters Canada Ltd • Frisco (TX)

Hybrid
USD 102,000 - 190,000
Hybrid work model
Flex My Way policies
Two company-wide Mental Health Days
+3
Senior Legal Content Success Manager – AI CoCounsel
Senior Legal Content Success Manager – AI CoCounsel

Thomson Reuters • Eagan (MN)

On-site
USD 93,000 - 173,000