Lead AI Evaluation & Benchmarking Engineer

Thomson Reuters; Ann Arbor (MI); Ibrido; USD 127.000 - 237.000; Tempo pieno

Vantaggi offerti da questo lavoro

Hybrid Work Model

Flex My Way

Career Development

Industry Competitive Benefits

Company Culture

Social Impact

Real-World Impact

Descrizione del lavoro

Thomson Reuters Labs seeks a Lead Research Engineer to design and deliver production-ready software for AI model evaluation and benchmarking. You will build scalable evaluation infra to compare LLMs, measure quality, cost, and latency, and guide model selection for products.

You’ll own the engineering approach from prototypes to reliable tools, collaborating with researchers, engineers, and product partners while shaping technical direction and delivery.

Competenze

• 8–10+ years building production systems with ML or data.
• Strong Python programming, API design, testing and data handling.
• Leadership in end-to-end delivery and collaboration with researchers.

Mansioni

• Lead delivery planning, staffing, and cost estimation for projects.
• Design scalable evaluation infrastructure and production Python software.
• Build automated evaluation pipelines linking model APIs, datasets, and scoring.
• Maintain repeatable experiments with traceable results and costs.
• Create user interfaces, docs, and evaluation reports for researchers.
• Ensure reliability, performance, and responsible data use.

Conoscenze

Python

API design

ML model evaluation

Cloud platforms

SQL

Team leadership

Mentoring

Research collaboration

Formazione

Bachelor's degree in CS/Engineering or equivalent

Strumenti

AWS

Azure

Descrizione del lavoro

Thomson Reuters Labs seeks a Lead Research Engineer to design and deliver production-ready software for AI model evaluation and benchmarking. You will build scalable evaluation infra to compare LLMs, measure quality, cost, and latency, and guide model selection for products.

You’ll own the engineering approach from prototypes to reliable tools, collaborating with researchers, engineers, and product partners while shaping technical direction and delivery.