Lead AI Evaluation & Benchmarking Engineer

Thomson Reuters; New York (NY); Hybrid; USD 127,000 - 273,000; Full time

Benefits offered by this job

Hybrid work model

Comprehensive benefits

Job summary

Thomson Reuters Labs seeks a Lead Research Engineer to design and deliver production-ready software for AI model evaluation and benchmarking. You will build scalable evaluation infrastructure to compare large language models, measure quality and latency, and guide model choices for products and customers.

Responsibilities include leading engineering delivery, extending tools, building reusable frameworks, and collaborating with research scientists and product partners to shape technical

Qualifications

• 8-10+ years of software engineering experience, with production ML/data systems.
• Strong Python programming including API design and testing.
• Experience leading end-to-end engineering delivery across teams.

Responsibilities

• Lead design and delivery of production-ready evaluation infrastructure for AI models.
• Build scalable evaluation pipelines connecting APIs, test datasets, and scoring methods.
• Ensure repeatable experiments with traceable results and reliable comparisons.

Skills

Python

Leadership

API design

Data analysis

Education

Bachelor's degree in CS/Engineering

Tools

AWS

Azure

SQL

Job description

Thomson Reuters Labs seeks a Lead Research Engineer to design and deliver production-ready software for AI model evaluation and benchmarking. You will build scalable evaluation infrastructure to compare large language models, measure quality and latency, and guide model choices for products and customers.

Responsibilities include leading engineering delivery, extending tools, building reusable frameworks, and collaborating with research scientists and product partners to shape technical