Lead AI Model-Serving Engineer

Thomson Reuters

Zug

On-site

CHF 140,000 - 210,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Hybrid Work Model
Flex My Way
Career Development
Industry Benefits
Culture of inclusion
Social Impact
Real-world impact

Job summary

Thomson Reuters Labs is seeking an hands-on infrastructure engineer to build and operate the Mariner serving stack. You will tune inference, optimize cost and latency, and improve observability while maintaining reliability as the platform scales to new product integrations and international deployments.

You will join as one of the founding engineers on a new team, reporting to the Director of Model Inference Engineering, with autonomy to shape technical strategy from the start.

Qualifications

  • Hands-on infrastructure engineering experience with Kubernetes or similar, production-ready systems.
  • Experience keeping model services up across multiple use cases, peak load and recovery.
  • Direct experience with model-serving infrastructure or inference optimization for large models.
  • Large-scale distributed systems experience under production load.
  • Strong debugging of distributed systems and production incidents.

Responsibilities

  • Build and operate the model-serving infrastructure that runs Thomson's production traffic.
  • Implement and tune inference-optimization techniques to reduce cost and latency without sacrificing quality.
  • Improve Mariner's observability as call volume and deployment surface grow.
  • Establish ISO 27001 controls, cost-tracking, and GPU-capacity contingency plans for reliability.
  • Document cost vs. latency vs. reliability tradeoffs for leadership and partners.
  • Collaborate with training and evaluation pods to deploy new model releases.
  • Help stand up the team’s practices and onboarding as an early member.
  • Coordinate with research, product, and engineering leadership to keep pace with releases.

Skills

Distributed systems
Production reliability
Autonomy
Leadership
Debugging incidents

Tools

Kubernetes
TensorRT
Triton
Go
Rust

Job description

Thomson Reuters Labs is seeking an hands-on infrastructure engineer to build and operate the Mariner serving stack. You will tune inference, optimize cost and latency, and improve observability while maintaining reliability as the platform scales to new product integrations and international deployments.

You will join as one of the founding engineers on a new team, reporting to the Director of Model Inference Engineering, with autonomy to shape technical strategy from the start.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Inference Engineer - Mariner Platform
Senior AI Inference Engineer - Mariner Platform

Thomson Reuters Corp. • Zug

Hybrid
CHF 140,000 - 210,000
Hybrid work model
Mental health days
Headspace access
Senior Model Inference Engineer
Senior Model Inference Engineer

Thomson Reuters Corp. • Basel

Hybrid
CHF 140,000 - 220,000
Hybrid Work Model
Flexibility & Work-Life Balance
Career Development and Growth
Lead, Model Inference Platform & Scale
Lead, Model Inference Platform & Scale

Thomson Reuters • Zug

Hybrid
CHF 180,000 - 260,000
Hybrid Work Model
Flex My Way policies
Career Development & Growth
Lead AI Inference Engineer — Scale Production Models
Lead AI Inference Engineer — Scale Production Models

Thomson Reuters • Zug

Hybrid
CHF 140,000 - 210,000
Hybrid Work Model
Career development opportunities
Health and well-being programs
Director, Model Inference Engineering — Hybrid AI Platform
Director, Model Inference Engineering — Hybrid AI Platform

Thomson Reuters Corp. • Basel

Hybrid
CHF 180,000 - 280,000
Hybrid Work Model
Career Development & Growth
Mental Health days & well-being
Lead ML Platform Engineer: Scale Trusted LLM Infrastructure
Lead ML Platform Engineer: Scale Trusted LLM Infrastructure

Thomson Reuters • Zug

Hybrid
CHF 180,000 - 250,000
Hybrid work model
Flexible work policy
Career development & growth
+4
Lead/Senior Engineer, Model Inference
Lead/Senior Engineer, Model Inference

Thomson Reuters • Zug

Hybrid
CHF 140,000 - 210,000
Hybrid Work Model
Career development opportunities
Health and well-being programs
Lead/Senior Engineer, Model Inference
Lead/Senior Engineer, Model Inference

Thomson Reuters • Zug

On-site
CHF 140,000 - 210,000
Hybrid Work Model
Flex My Way
Career Development
+4
Director, Model Inference Engineering
Director, Model Inference Engineering

Thomson Reuters • Zug

Hybrid
CHF 180,000 - 260,000
Hybrid Work Model
Flex My Way policies
Career Development & Growth
Lead ML Platform Engineer – Hybrid LLM Infra
Lead ML Platform Engineer – Hybrid LLM Infra

Thomson Reuters Corp. • Basel

Hybrid
CHF 150,000 - 210,000
Hybrid work environment
Career development and growth programs
Mental health days and wellness
Top locations