Senior AI Evaluation Engineer - LLM Benchmarks & Scale

Thomson Reuters

Zug

Hybrid

CHF 120,000 - 170,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Hybrid Work Model
Flex My Way
Grow My Way
Mental Health Days

Job summary

Thomson Reuters Labs is seeking a Research Engineer to design, develop, optimize, and scale an evaluation suite for fiduciary-grade AI used in professional workflows. You will work with researchers to push the frontier of multi-agent systems and decision models, ensuring models are tested and ready for production integrations.

You will build scalable evaluation pipelines, partner with cross-functional teams, and contribute to production-readiness and security standards while advancing Thomson

Qualifications

  • Hands-on research engineering experience in evaluations with scalable, built evaluation suites.
  • Experience translating research ideas into scalable systems with researchers and cross-functional stakeholders.
  • Experience ensuring reliability and scalability of research systems.
  • Familiarity with current developments in LLMs and designing flexible evaluation platforms.

Responsibilities

  • Build and operate the evaluation suite that runs Thomson evaluations.
  • Design and develop a scalable platform for growing evaluation workloads.
  • Implement optimization techniques to reduce cost and latency without compromising quality.
  • Contribute to ISO 27001 compliance efforts.
  • Collaborate with the evaluation pod to test new model releases on the leaderboard.

Skills

Evaluation engineering
Cross-functional collaboration
System reliability
LLMs familiarity

Tools

Inspect
Harbor
lm-evaluation-harness

Job description

Thomson Reuters Labs is seeking a Research Engineer to design, develop, optimize, and scale an evaluation suite for fiduciary-grade AI used in professional workflows. You will work with researchers to push the frontier of multi-agent systems and decision models, ensuring models are tested and ready for production integrations.

You will build scalable evaluation pipelines, partner with cross-functional teams, and contribute to production-readiness and security standards while advancing Thomson

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Research Engineer, Model Evaluations — Scale & Optimize
Senior Research Engineer, Model Evaluations — Scale & Optimize

Thomson Reuters • Zug

Hybrid
CHF 120,000 - 180,000
Hybrid Work Model
Flexible vacation
Mental Health Days off
+3
Lead Research Scientist, Model Evaluations & Benchmarks
Lead Research Scientist, Model Evaluations & Benchmarks

Thomson Reuters Corp. • Basel

Hybrid
CHF 150,000 - 190,000
Lead Research Scientist, LLM Evaluation & Benchmarks
Lead Research Scientist, LLM Evaluation & Benchmarks

Thomson Reuters • Zug

Hybrid
CHF 140,000 - 210,000
Hybrid work model
Flexible vacation
Mental health days
+1
Lead Research Scientist, AI Evaluation & Benchmarks
Lead Research Scientist, AI Evaluation & Benchmarks

Thomson Reuters Corp. • Zug

Hybrid
CHF 140,000 - 200,000
Senior Research Engineer, Model Evaluations
Senior Research Engineer, Model Evaluations

Thomson Reuters • Zug

Hybrid
CHF 120,000 - 170,000
Hybrid Work Model
Flex My Way
Grow My Way
+1
Senior Research Engineer, Model Evaluations
Senior Research Engineer, Model Evaluations

Thomson Reuters • Zug

Hybrid
CHF 120,000 - 180,000
Hybrid Work Model
Flexible vacation
Mental Health Days off
+3
Senior/Lead Research Scientist, Model Evaluations
Senior/Lead Research Scientist, Model Evaluations

Thomson Reuters • Zug

Hybrid
CHF 140,000 - 210,000
Hybrid work model
Flexible vacation
Mental health days
+1
Senior/Lead Research Scientist, Model Evaluations
Senior/Lead Research Scientist, Model Evaluations

Thomson Reuters • Zug

Hybrid
CHF 140,000 - 210,000
Hybrid Work Model
Flex My Way
Grow My Way
+4
Senior/Lead Research Scientist, Model Evaluations
Senior/Lead Research Scientist, Model Evaluations

Thomson Reuters Corp. • Basel

Hybrid
CHF 150,000 - 190,000
Senior/Lead Research Scientist, Model Evaluations
Senior/Lead Research Scientist, Model Evaluations

Thomson Reuters Corp. • Zug

Hybrid
CHF 140,000 - 200,000
Top locations