Lead AI Evaluation & Benchmarking Engineer

Thomson Reuters; Frisco (TX); Hybrid; USD 127,000 - 237,000; Full time

Benefits offered by this job

Hybrid work model

Flexible vacation

Mental health days

Job summary

Thomson Reuters Labs is seeking a Lead Research Engineer to design and deliver production-ready software for AI model evaluation and benchmarking. You will build scalable evaluation infrastructure to compare large language models, measure quality, cost, and latency, and help select model development directions.

You will own the engineering approach from prototypes to maintainable tools, collaborating with researchers, engineers, and product partners to shape technical direction and delivery.

Qualifications

• 8-10+ years of relevant software engineering experience.
• Strong hands-on Python programming skills, including API design, automated testing.
• Leadership and end-to-end delivery experience across projects.

Responsibilities

• Lead technical delivery and engineering planning with leaders.
• Design and build scalable evaluation infrastructure and provide production-quality Python software.
• Turn research methods into working software and automate evaluation pipelines.

Skills

Python

API design

Automated testing

Leadership

Cloud platforms

SQL

Education

Bachelors in CS/Engineering

Tools

AWS

Azure

SQL

Job description

Thomson Reuters Labs is seeking a Lead Research Engineer to design and deliver production-ready software for AI model evaluation and benchmarking. You will build scalable evaluation infrastructure to compare large language models, measure quality, cost, and latency, and help select model development directions.

You will own the engineering approach from prototypes to maintainable tools, collaborating with researchers, engineers, and product partners to shape technical direction and delivery.