Senior Legal AI Prompting & Evaluation Lead

Thomson Reuters

Frisco (TX)

Hybrid

USD 120,000 - 222,000

Full time

12 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Hybrid work model
Career development opportunities
Mental health days
Tuition reimbursement
Volunteer days
Headspace access

Job summary

Thomson Reuters in Frisco, TX is seeking a Senior Legal AI Prompter/Evaluator to lead prompt design, model evaluation, and the integration of LLMs into legal workflows. You will work with SMEs, software engineers, and data scientists to ensure accurate, legally sound AI outputs for professionals.

As a senior member, you will design experiments, mentor teammates, and shape evaluation rubrics to measure success, with a focus on responsible AI and practical legal outcomes.

Qualifications

  • Juris Doctor degree or equivalent law degree and bar admission in a US or Canadian jurisdiction.
  • 5-7 years of combined experience, including 2-3 years of legal practice, with remaining years in related work such as collaborating with software engineers or applying generative AI.
  • Proven expertise applying generative AI, including prompt engineering and evaluating model outputs.
  • Proficiency working in a Python code base and using Git, including calling LLMs through code.
  • Excellent communication and collaboration skills across legal SMEs and cross functions.

Responsibilities

  • Create, test, and refine prompts, skills, and agent configurations for CoCounsel Legal.
  • Experiment with Thomson and other LLMs on legal tasks to compare results.
  • Build gold-standard datasets with SMEs and design evaluation schemes.
  • Write and run scripts, experiments, and automated tests for large datasets.
  • Monitor production performance and analyze failure modes to provide feedback to engineers.
  • Collaborate with software engineers, data scientists and cross-functional teams.
  • Engage with legal professionals and stakeholders to gather insights and validate concepts.
  • Mentor colleagues and draft guidance materials and best-practice documentation.

Skills

Prompt engineering
Python
Git
LLMs
Legal tech
Technical writing

Education

Juris Doctor
Bar admission (US/Canada)

Tools

OpenAI
Anthropic
Gemini

Job description

Thomson Reuters in Frisco, TX is seeking a Senior Legal AI Prompter/Evaluator to lead prompt design, model evaluation, and the integration of LLMs into legal workflows. You will work with SMEs, software engineers, and data scientists to ensure accurate, legally sound AI outputs for professionals.

As a senior member, you will design experiments, mentor teammates, and shape evaluation rubrics to measure success, with a focus on responsible AI and practical legal outcomes.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Legal AI Prompter & Evaluator (Hybrid)
Senior Legal AI Prompter & Evaluator (Hybrid)

Thomson Reuters • New York (NY)

Hybrid
USD 120,000 - 222,000
Hybrid work model
Mental health days
Tuition reimbursement
+2
Senior Legal AI Prompt Engineer & Evaluator
Senior Legal AI Prompt Engineer & Evaluator

USA018 Thomson Reuters Holdings Inc. • Eagan (MN)

Hybrid
USD 120,000 - 222,000
Hybrid Work Model
Flex My Way
Career Development
+2
Senior Legal AI Prompt Engineer and Evaluator
Senior Legal AI Prompt Engineer and Evaluator

Thomson Reuters  • Eagan (MN), Frisco (TX), New York (NY)

Hybrid
USD 120,000 - 222,000
Hybrid work model
Career development and growth
Mental health days off
Senior Legal AI Prompt Engineer & Evaluator
Senior Legal AI Prompt Engineer & Evaluator

Thomson Reuters • Eagan (MN)

Hybrid
USD 120,000 - 222,000
Hybrid Work Model
Flexible vacation
Mental Health Days
+3
Senior AI Engineer for Legal Tech, Production-Ready
Senior AI Engineer for Legal Tech, Production-Ready

Thomson Reuters • Frisco (TX)

On-site
USD 118,000 - 220,000
Hybrid work model
Mental health days
Tuition reimbursement
Senior AI Solutions Lead - Legal Tech
Senior AI Solutions Lead - Legal Tech

Thomson Reuters • Washington

Hybrid
USD 120,000 - 222,000
Hybrid work
Career growth
Benefits package
+1
Lead AI Solutions Architect – Legal Tech
Lead AI Solutions Architect – Legal Tech

Thomson Reuters  • Eagan (MN), Frisco (TX), New York (NY), Washington

Hybrid
USD 120,000 - 222,000
Two company mental health days off
401k plan with company match
Tuition reimbursement
+1
Senior AI Solutions Lead - Legal Tech (Hybrid)
Senior AI Solutions Lead - Legal Tech (Hybrid)

Thomson Reuters • Frisco (TX)

Hybrid
USD 120,000 - 222,000
Hybrid Work Model
Mental Health Days
Tuition Reimbursement
+1
Lead AI Solutions Architect - Legal Research Tools
Lead AI Solutions Architect - Legal Research Tools

Thomson Reuters • Eagan (MN)

Hybrid
USD 120,000 - 222,000
Hybrid Work Model
Career Development and Growth
Comprehensive Benefits
+1
Senior Legal AI Engineer - Cloud-Native Law Tech
Senior Legal AI Engineer - Cloud-Native Law Tech

Thomson Reuters • Eagan (MN)

Hybrid
USD 102,000 - 190,000
Hybrid Work Model
Flexibility & Work-Life Balance
Career Development and Growth
+2