Senior AI Benchmarking & Evaluation Engineer

Thomson Reuters; Frisco (TX); Hybrid; USD 127,000 - 237,000; Full time

Benefits offered by this job

Hybrid Work Model

Career Development

Comprehensive Benefits

Mental health days

Tuition reimbursement

Job summary

Thomson Reuters Labs seeks a Lead Research Engineer to design and deliver production-ready software for AI model evaluation and benchmarking. You will build scalable evaluation infrastructure to compare large language models, measure quality, cost, and latency, and help select models for product use.

You will own the engineering approach from prototypes to reliable tools, collaborating with researchers and product teams while guiding technical direction and delivery.

Qualifications

• 8-10+ years of software engineering experience, including production systems involving machine learning or complex data.
• Strong hands-on Python programming, including API design, automated testing, and working with structured and unstructured data.
• Technical leadership and end-to-end delivery experience, including architecture decisions and staffing.
• Experience collaborating with researchers or ML practitioners to translate experiments into working software.
• Experience integrating or testing ML models, and understanding model evaluation and data leakage risks.
• Cloud engineering experience with AWS or Azure, including distributed workflows and monitoring.
• Working knowledge of SQL and data processing across structured and unstructured data.
• Strong collaboration and mentoring skills across research, engineering, and product teams.

Responsibilities

• Lead technical delivery and engineering planning with stakeholders.
• Design and build scalable evaluation infrastructure and production-quality Python software.
• Turn research methods into working software with automated evaluation pipelines.
• Ensure reliable, reproducible model comparisons with traceability of inputs and methods.
• Develop user interfaces, documentation, evaluation reports, and diagnostics.
• Own production reliability, testing, deployment, and data governance from inception.

Skills

Python programming

API design

End-to-end delivery

Cloud engineering

SQL

Collaboration

Education

Bachelor's degree in Computer Science or Engineering

Tools

APIs

Automated testing

SQL tooling

Python libraries

Job description

Thomson Reuters Labs seeks a Lead Research Engineer to design and deliver production-ready software for AI model evaluation and benchmarking. You will build scalable evaluation infrastructure to compare large language models, measure quality, cost, and latency, and help select models for product use.

You will own the engineering approach from prototypes to reliable tools, collaborating with researchers and product teams while guiding technical direction and delivery.