Lead AI Evaluation & Benchmarking Engineer (Hybrid)

Thomson Reuters Corp.; New York (NY); Hybrid; USD 127,000 - 237,000; Full time

Benefits offered by this job

Hybrid Work Model

Tuition Reimbursement

Mental Health Days

Job summary

Thomson Reuters Corp. is seeking a Lead Research Engineer to design and deliver production-quality software for AI model evaluation and benchmarking.

You will build scalable evaluation infrastructure enabling research and product teams to compare large language models, measure quality, cost, and latency, and guide model development. You will own the engineering approach from prototypes to reliable tools, collaborating with scientists, engineers, and product partners to shape technical direction

Qualifications

• 8-10+ years of software engineering experience including production ML systems.
• Strong Python programming, API design, testing, and data handling.
• Technical leadership and end-to-end delivery experience.

Responsibilities

• Lead engineering delivery, planning, and staffing for AI evaluation projects.
• Design scalable evaluation infrastructure and production-quality Python tools.
• Build automated evaluation pipelines connecting models, data, and scoring methods.

Skills

Python programming

Software engineering

Leadership

Cloud computing

SQL

Collaboration

Experimentation with ML

Education

Bachelor's degree in Computer Science or Engineering

Tools

AWS

Azure

APIs

Job description

Thomson Reuters Corp. is seeking a Lead Research Engineer to design and deliver production-quality software for AI model evaluation and benchmarking.

You will build scalable evaluation infrastructure enabling research and product teams to compare large language models, measure quality, cost, and latency, and guide model development. You will own the engineering approach from prototypes to reliable tools, collaborating with scientists, engineers, and product partners to shape technical direction