Lead, Model Inference Platform & Scale

Thomson Reuters

Zug

Hybrid

CHF 180,000 - 260,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Hybrid Work Model
Flex My Way policies
Career Development & Growth

Job summary

Thomson Reuters Labs seeks a hands-on Infrastructure Engineer to own the model-serving stack for Mariner, Thomson's custom inference platform. You will tune inference, optimize cost and latency, and keep production traffic reliable as the system scales to new product integrations and international deployments.

You'll join as an early member of a new team reporting to the Director, Model Inference Engineering, with autonomy to shape the team's technical direction and engineering practices from

Qualifications

  • Hands-on infrastructure engineering with Kubernetes or similar, production ownership.
  • Experience keeping model services up across peak load and DR scenarios.
  • Direct experience with model-serving infra and inference optimization for large models.
  • Large-scale distributed systems in production, with scaling and reliability.
  • Debugging distributed systems and production incidents under real traffic.
  • Track record shipping software end to end: design, build, operate production systems.
  • Champion and enforce engineering best practices with changing product requirements.
  • Operate autonomously as an early lead engineer and mentor others as the team grows.

Responsibilities

  • Build and operate the model-serving infrastructure that runs Thomson's production traffic.
  • Implement and tune inference-optimization techniques to reduce cost and latency without compromising quality.
  • Improve Mariner's observability as call volume grows.
  • Build out production footing: ISO 27001 controls, cost-tracking, GPU-capacity contingency plans.
  • Document cost vs. latency vs. reliability tradeoffs and bring to leadership.
  • Collaborate with training/evaluation pods to deploy new model releases live.
  • Help establish team practices and tooling (on-call, incident reviews, onboarding).
  • Collaborate with research, product, and engineering leadership to keep the serving stack up to date with model releases.

Skills

Kubernetes
Production systems
Disaster recovery
Model-serving infra
Distributed systems
Debugging under traffic
End-to-end software delivery
Engineering best practices
Autonomous leadership

Tools

vLLM
TensorRT-LLM
Triton
SGLang

Job description

Thomson Reuters Labs seeks a hands-on Infrastructure Engineer to own the model-serving stack for Mariner, Thomson's custom inference platform. You will tune inference, optimize cost and latency, and keep production traffic reliable as the system scales to new product integrations and international deployments.

You'll join as an early member of a new team reporting to the Director, Model Inference Engineering, with autonomy to shape the team's technical direction and engineering practices from

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Model Inference Engineer
Senior Model Inference Engineer

Thomson Reuters Corp. • Basel

Hybrid
CHF 140,000 - 220,000
Hybrid Work Model
Flexibility & Work-Life Balance
Career Development and Growth
Lead AI Model-Serving Engineer
Lead AI Model-Serving Engineer

Thomson Reuters • Zug

On-site
CHF 140,000 - 210,000
Hybrid Work Model
Flex My Way
Career Development
+4
Director, Model Inference Engineering — Hybrid AI Platform
Director, Model Inference Engineering — Hybrid AI Platform

Thomson Reuters Corp. • Basel

Hybrid
CHF 180,000 - 280,000
Hybrid Work Model
Career Development & Growth
Mental Health days & well-being
Lead AI Inference Engineer — Scale Production Models
Lead AI Inference Engineer — Scale Production Models

Thomson Reuters • Zug

Hybrid
CHF 140,000 - 210,000
Hybrid Work Model
Career development opportunities
Health and well-being programs
Senior AI Inference Engineer - Mariner Platform
Senior AI Inference Engineer - Mariner Platform

Thomson Reuters Corp. • Zug

Hybrid
CHF 140,000 - 210,000
Hybrid work model
Mental health days
Headspace access
Lead ML Platform Engineer: Scale Trusted LLM Infrastructure
Lead ML Platform Engineer: Scale Trusted LLM Infrastructure

Thomson Reuters • Zug

Hybrid
CHF 180,000 - 250,000
Hybrid work model
Flexible work policy
Career development & growth
+4
Lead/Senior Engineer, Model Inference
Lead/Senior Engineer, Model Inference

Thomson Reuters • Zug

Hybrid
CHF 140,000 - 210,000
Hybrid Work Model
Career development opportunities
Health and well-being programs
Lead/Senior Engineer, Model Inference
Lead/Senior Engineer, Model Inference

Thomson Reuters • Zug

On-site
CHF 140,000 - 210,000
Hybrid Work Model
Flex My Way
Career Development
+4
Lead ML Platform Engineer – Hybrid LLM Infra
Lead ML Platform Engineer – Hybrid LLM Infra

Thomson Reuters Corp. • Basel

Hybrid
CHF 150,000 - 210,000
Hybrid work environment
Career development and growth programs
Mental health days and wellness
Director, Model Inference Engineering
Director, Model Inference Engineering

Thomson Reuters • Zug

Hybrid
CHF 180,000 - 260,000
Hybrid Work Model
Flex My Way policies
Career Development & Growth
Top locations