Senior Model Inference Engineer

Thomson Reuters Corp.

Basel

Hybrid

CHF 140,000 - 220,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Hybrid Work Model
Flexibility & Work-Life Balance
Career Development and Growth

Job summary

Thomson Reuters Labs seeks a Lead/Senior Engineer to build and operate the model-serving infrastructure (Mariner) that handles Thomson's production traffic. You will own the serving stack, optimize inference for cost and latency, and ensure reliability as deployments scale across product lines.

This hands-on role requires production-ready mindset, collaboration with training, research, and product teams, and autonomous leadership as one of the first engineers on a new team in a hybrid setup

Qualifications

  • Hands-on infrastructure engineering experience with Kubernetes or similar, in production.
  • Experience keeping model services up across multiple use cases: peak load, scaling, disaster recovery.
  • Direct experience with model-serving infrastructure and/or inference optimization for large models.
  • Large-scale distributed systems experience, including scaling and reliability under production load.
  • Comfort debugging distributed systems and production incidents under real traffic.

Responsibilities

  • Build and operate the model-serving infrastructure that runs Thomson's production traffic.
  • Implement and tune inference-optimization techniques to reduce cost and latency without sacrificing quality.
  • Improve Mariner's observability as call volume and the deployment surface grow.
  • Build production footing: ISO 27001 controls, cost-tracking, GPU-capacity contingency plans.
  • Document cost vs. latency vs. reliability tradeoffs and present to leadership.
  • Collaborate with training/evaluation to deploy new model releases.
  • Help stand up team practices and tooling for early-stage engineering.

Skills

Distributed systems
Production-grade software
Autonomous work

Tools

Kubernetes
Go
Rust
TensorRT-LLM
vLLM
Triton

Job description

Thomson Reuters Labs seeks a Lead/Senior Engineer to build and operate the model-serving infrastructure (Mariner) that handles Thomson's production traffic. You will own the serving stack, optimize inference for cost and latency, and ensure reliability as deployments scale across product lines.

This hands-on role requires production-ready mindset, collaboration with training, research, and product teams, and autonomous leadership as one of the first engineers on a new team in a hybrid setup

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead, Model Inference Platform & Scale
Lead, Model Inference Platform & Scale

Thomson Reuters • Zug

Hybrid
CHF 180,000 - 260,000
Hybrid Work Model
Flex My Way policies
Career Development & Growth
Lead AI Model-Serving Engineer
Lead AI Model-Serving Engineer

Thomson Reuters • Zug

On-site
CHF 140,000 - 210,000
Hybrid Work Model
Flex My Way
Career Development
+4
Director, Model Inference Engineering — Hybrid AI Platform
Director, Model Inference Engineering — Hybrid AI Platform

Thomson Reuters Corp. • Basel

Hybrid
CHF 180,000 - 280,000
Hybrid Work Model
Career Development & Growth
Mental Health days & well-being
Senior AI Inference Engineer - Mariner Platform
Senior AI Inference Engineer - Mariner Platform

Thomson Reuters Corp. • Zug

Hybrid
CHF 140,000 - 210,000
Hybrid work model
Mental health days
Headspace access
Lead AI Inference Engineer — Scale Production Models
Lead AI Inference Engineer — Scale Production Models

Thomson Reuters • Zug

Hybrid
CHF 140,000 - 210,000
Hybrid Work Model
Career development opportunities
Health and well-being programs
Lead/Senior Engineer, Model Inference
Lead/Senior Engineer, Model Inference

Thomson Reuters • Zug

Hybrid
CHF 140,000 - 210,000
Hybrid Work Model
Career development opportunities
Health and well-being programs
Lead/Senior Engineer, Model Inference
Lead/Senior Engineer, Model Inference

Thomson Reuters • Zug

On-site
CHF 140,000 - 210,000
Hybrid Work Model
Flex My Way
Career Development
+4
Director, Model Inference Engineering
Director, Model Inference Engineering

Thomson Reuters • Zug

Hybrid
CHF 180,000 - 260,000
Hybrid Work Model
Flex My Way policies
Career Development & Growth
Lead/Senior Engineer, Model Inference
Lead/Senior Engineer, Model Inference

Thomson Reuters Corp. • Zug

Hybrid
CHF 140,000 - 210,000
Hybrid work model
Mental health days
Headspace access
Lead/Senior Engineer, Model Inference
Lead/Senior Engineer, Model Inference

Thomson Reuters Corp. • Basel

Hybrid
CHF 140,000 - 220,000
Hybrid Work Model
Flexibility & Work-Life Balance
Career Development and Growth
Top locations