Director, Model Inference Engineering

Thomson Reuters Corp.

Town of Ontario (NY)

Hybride

USD 184 000 - 394 000

Plein temps

Il y a 4 jours
Soyez parmi les premiers à postuler

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Avantages offerts par ce poste

Hybrid work model
Career development
Industry competitive benefits

Résumé du poste

Thomson Reuters Labs seeks a Director, Model Inference Engineering to lead the inference-engineering team and scale Mariner across regions. You will own the engineering roadmap, balance cost and latency, and ensure production readiness while collaborating with research and product stakeholders.

We value production ML-serving depth, cost ownership, and leadership experience; this role offers hybrid work options and a strong benefits program in a globally impactful company.

Qualifications

  • Production ML-serving depth in large-model deployments.
  • Ownership of cost-attribution and compliance programs.
  • Experience building and leading a focused engineering team.

Responsabilités

  • Grow the inference-engineering team and hiring bar.
  • Own delivery of Mariner's engineering roadmap with cross-functional partners.
  • Scale production footing including cost-tracking and ISO27001 compliance.

Connaissances

ML serving depth
Leadership
Cost ownership
GPU capacity planning
Cross-functional collaboration
Production-scale systems

Outils

Kubernetes
Rust
Go

Description du poste

# Careers at Thomson Reuters## Director, Model Inference EngineeringApply: Hybrid: United States of America, Eagan, Minnesota: United States of America, Frisco, Texas: United States of America, New York, New York: Canada, Toronto, Ontario: United States of America, Ann Arbor, Michigan: Full time: Posted Today: End Date: March 31, 2027 (30+ days left to apply): JREQ205597**Job Description**Thomson Reuters Labs is the global research and development division of Thomson Reuters. We bring together scientists, engineers, and domain experts to explore emerging technologies and develop state-of-the-art AI products, bridging frontier science with practical application. Labs builds and ships custom models for professional workflows requiring fiduciary-grade AI. The Thomson LLM model family was developed by training leading open-weight models on decades of authoritative Thomson Reuters content, with thousands of hours of subject-matter-expert input. Owning the model layer is how we earn trust in the most regulated, highest-stakes professional workflows. Mariner, Thomson Reuters' custom inference platform, serves every production call to the Thomson model family and is scaling to new product integrations and business lines. This Director, Model Inference Engineering role leads and grows the team that owns the platform, working with senior technical leadership and a cross-functional team to ensure production footing, cost-tracking, compliance, and capacity planning as we scale. You'll lead the inference-engineering team and partner closely with research and product stakeholders, so the serving stack keeps pace with new model releases and product expansion. For more on the latest model release, see the Thomson 1.0 Technical Report on Hugging Face: https://huggingface.co/spaces/tri-fair-lab/publications/blob/main/Thomson\\_1\\_0\\_Technical\\_Report.pdf **Key Responsibilities*** **Grow the inference-engineering team:** set the hiring bar, run performance and growth conversations, retain in a competitive market, and build an effective and sustainable operating rhythm (on-call, incident reviews, onboarding) as the system expands internationally.* **Own delivery of Mariner's engineering roadmap:** work with technical leadership, engineers, and researchers to plan and resource against objectives and key results, driving product integrations and international deployment while balancing cost/latency targets.* **Scale Thomson's production footing:** drive the ISO 27001 compliance path, deliver clean cost-tracking and attribution for Finance, and run GPU-capacity contingency planning so a capacity change doesn't force downtime or costly parallel running.* **Represent inference-engineering tradeoffs** (cost vs. latency vs. reliability) to senior leadership and cross-functional partners.* **Ensure token-economics benchmarks are produced and published**, showing Thomson's cost advantage over closed-model APIs when the numbers support it. **Required Qualifications*** **Production ML-serving depth.** You've led or managed inference infrastructure for large models at real production traffic and scale, not just in a research or prototype setting, with wins delivered by teams you led that you can point to, and the fluency to hire, coach, and defend the work.* **Infrastructure and cost ownership.** You've owned a cost-attribution or compliance program end to end (control design, evidence collection, external audit such as ISO 27001, SOC 2, or comparable) for a production system on Kubernetes or similar.* **Track record building and leading a focused engineering team,** ideally growing a team from a handful of engineers rather than inheriting one at scale.* **Experience balancing resource constraints.** GPU capacity, region availability, and cost are active, managed constraints in this role, not abstractions.* **Experience supporting external-facing or customer-facing deployments**, not only internal research infrastructure.* **Operational excellence** in engineering teams and systems. **Preferred Qualifications*** Experience with common LLM-serving stacks (vLLM, TensorRT-LLM, Triton, SGLang, or similar).* Experience working with research and product stakeholders to define the engineering roadmap of a production system.* Exposure to GPU-cluster capacity planning or multi-region/multi-cloud deployment.* Familiarity with systems development languages (Rust, Go, etc.).* Exposure to a regulated or compliance-heavy production environment. Even if you don't have all of the above requirements, we encourage you to apply to explore a mutual fit!#LI-MW1This posting is for proactive recruitment purposes and may be used to fill current openings or future vacancies within our organization. **What’s in it For You?*** **Hybrid Work Model:** We’ve adopted a flexible hybrid working environment for our office-based roles while delivering a seamless experience that is digitally and physically connected.* **Flexibility & Work-Life Balance:** Flex My Way is a set of supportive workplace policies designed to help manage personal and professional responsibilities, whether caring for family, giving back to the community, or finding time to refresh and reset. This builds upon our flexible work arrangements, including work from anywhere for up to 8 weeks per year, empowering employees to achieve a better work-life balance.* **Career Development and Growth:** By fostering a culture of continuous learning and skill development, we prepare our talent to tackle tomorrow’s challenges and deliver real-world solutions. Our Grow My Way programming and skills-first approach ensures you have the tools and knowledge to grow, lead, and thrive in an AI-enabled future.* **Industry Competitive Benefits:** We offer comprehensive benefit plans to include flexible vacation, two company-wide Mental Health Days off, access to the Headspace app, retirement savings, tuition reimbursement, employee incentive programs, and resources for mental, physical, and financial wellbeing.* **Culture:** Globally recognized, award-winning reputation for inclusion and belonging, flexibility, work-life balance, and more. We live by our values: Obsess over our Customers, Compete to Win, Challenge (Y)our Thinking, Act Fast / Learn Fast, and Stronger Together.* **Social Impact:** Make an impact in your community with our Social Impact Institute. We offer employees two paid volunteer days off annually and opportunities to get involved with pro-bono consulting projects and Environmental, Social, and Governance (ESG) initiatives.* **Making a Real-World Impact:** We are one of the few companies globally that helps its customers pursue justice, truth, and transparency. Together, with the professionals and institutions we serve, we help uphold the rule of law, turn the wheels of commerce, catch bad actors, report the facts, and provide trusted, unbiased information to people all over the world. Our use of AI within the recruitment process Thomson Reuters utilizes Artificial Intelligence (AI) to support parts of our global recruitment process. Unless you opt-out, our AI system will assess the information provided by you and compare it to the requirements listed for the role, and present the result to our recruitment personnel for further review. The AI system acts as a supporting tool, but there is always a human making the decision if you will be considered for the role.In the United States, Thomson Reuters offers a comprehensive benefits package to our employees. Our benefit package includes market competitive health, dental, vision, disability, and life insurance programs, as well as a competitive 401k plan with company match. In addition, Thomson Reuters offers market leading work life benefits with competitive vacation, sick and safe paid time off, paid holidays (including two company mental health days off), parental leave, sabbatical leave. These benefits meet or exceeds the requirements of paid time off in accordance with any applicable state or municipal laws. Finally, Thomson Reuters offers the following additional benefits: optional hospital, accident and sickness insurance paid 100% by the employee; optional life and AD&D insurance paid 100% by the employee; Flexible Spending and Health Savings Accounts; fitness reimbursement; access to Employee Assistance Program; Group Legal Identity Theft Protection benefit paid 100% by employee; access to 529 Plan; commuter benefits; Adoption & Surrogacy Assistance; Tuition Reimbursement; and access to Employee Stock Purchase Plan.Thomson Reuters complies with local laws that require upfront disclosure of the expected pay range for a position. The base compensation range varies across locations.Eligible office location(s) for this role include one or more of the following: New York City, San Francisco, Los Angeles, and/or Irvine, CA; McLean, VA; Washington, DC. The base compensation range for the role in any of those locations is $212,100 USD - $393,900 USD.For any eligible US locations, unless otherwise noted, the base compensation range for this role is $184,100 USD - $341,900 USD.Base pay is positioned within the range based on several factors including an individual’s knowledge, skills and experience with consideration given to internal equity. Base pay is one part of a comprehensive Total Reward program which also includes flexible and supportive benefits and other wellbeing programs.This role may also be eligible for an Annual Bonus based on a combination of enterprise and individual performance.
Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Lead Research Engineer – AI Evaluation & Benchmarking
Lead Research Engineer – AI Evaluation & Benchmarking

Thomson Reuters  • New York (NY)

Hybride
USD 127 000 - 273 000
Lead Research Engineer – AI Evaluation & Benchmarking
Lead Research Engineer – AI Evaluation & Benchmarking

Thomson Reuters  • New York (NY)

Hybride
USD 127 000 - 273 000
Hybrid work model
Comprehensive benefits
Senior/Lead Research Engineer (Foundation Models)
Senior/Lead Research Engineer (Foundation Models)

Thomson Reuters Corp. • Town of Ontario (NY)

À distance
USD 118 000 - 220 000
Flexible vacation
Mental health days
Headspace app
+3
Lead Research Engineer – AI Evaluation & Benchmarking
Lead Research Engineer – AI Evaluation & Benchmarking

Thomson Reuters  • New York (NY)

Hybride
USD 127 000 - 237 000
Hybrid Work Model
Tuition Reimbursement
Mental Health Days
Director, Model Inference Engineering
Director, Model Inference Engineering

Thomson Reuters • Eagan (MN)

Hybride
USD 184 000 - 342 000
Hybrid Work Model
Career development
Competitive benefits
+1
Senior Inference Engineer - AI
Senior Inference Engineer - AI

Thomson Reuters  • Eagan (MN)

Hybride
USD 122 520 - 204 200
Senior Inference Engineer - AI
Senior Inference Engineer - AI

Thomson Reuters  • Eagan (MN)

Hybride
USD 110 000 - 204 000
Hybrid Work Model
Flexibility & Work-Life Balance
Career Development and Growth
Staff Software Engineer – AI
Staff Software Engineer – AI

Thomson Reuters  • Eagan (MN)

Hybride
USD 127 000 - 237 000
Lead Research Engineer
Lead Research Engineer

Thomson Reuters  • Eagan (MN)

Hybride
USD 127 000 - 237 000
Senior Research Engineer
Senior Research Engineer

Thomson Reuters • Eagan (MN)

Hybride
USD 110 000 - 235 000
Hybrid Work Model
Flex My Way
Career Development
+3