AI Reliability & Quality Lead

Thomson Reuters; Eagan (MN); Hybrid; USD 91,000 - 169,000; Full time

Benefits offered by this job

Hybrid Work Model

Mental Health Days

Job summary

Thomson Reuters in Minnesota is hiring an AI Reliability Manager to own evaluation data, quality signals, and release readiness for CLEAR, our investigative platform. You will measure AI accuracy, drive improvements, and translate customer issues into actionable engineering work in a hands-on, collaborative role.

Join a role that combines rigorous analysis with cross-functional partnership across product, engineering, and data science to ensure trustworthy AI outcomes for law enforcement,

Qualifications

• 3+ years in work requiring careful judgment about quality.
• Experience applying consistent standards to open-ended work.
• Hands-on use of generative AI tools with critical thinking.
• Strong written communication to non-technical audiences.

Responsibilities

• Own and extend gold datasets, annotation guidelines, and scoring rubrics to evaluate AI output for accuracy, completeness, and sourcing.
• Analyze results to identify failure patterns, quantify impact, and guide engineering focus.
• Test and validate AI features prior to release and provide evidence-based release readiness.</br>
• Train and support distributed annotator resources to apply guidelines consistently.
• Open and manage engineering tickets and drive resolution with product, engineering, and data science partners.

Skills

Quality judgment

AI evaluation

Written communication

Cross-functional collaboration

Tools

Generative AI tools

Job description

Thomson Reuters in Minnesota is hiring an AI Reliability Manager to own evaluation data, quality signals, and release readiness for CLEAR, our investigative platform. You will measure AI accuracy, drive improvements, and translate customer issues into actionable engineering work in a hands-on, collaborative role.

Join a role that combines rigorous analysis with cross-functional partnership across product, engineering, and data science to ensure trustworthy AI outcomes for law enforcement,