LLM Ops Engineer

LSEG; Nottingham; On-site; GBP 70,000 - 100,000; Full time

Benefits offered by this job

Healthcare

Retirement planning

Paid volunteering days

Wellbeing initiatives

Job summary

A leading financial data provider in the United Kingdom is seeking an LLM Ops Engineer to ensure the reliability and performance of LLMs in production environments. This Senior Associate role involves managing model lifecycle, configuring platform integrations, and monitoring performance. Candidates must have experience in LLM Ops and significant expertise in Python, cloud platforms and monitoring tools. This role offers competitive benefits including healthcare and retirement planning.

Qualifications

• Proven experience in LLM Ops, MLOps, or AI infrastructure roles.
• Strong understanding of LLM behaviour, fine-tuning, and prompt engineering.
• Experience with cloud platforms (AWS, Azure, or GCP) and containerization.
• Experience with AWS Bedrock LLM models.
• Proficiency in Python and familiarity with ML frameworks such as Hugging Face Transformers and LangChain.
• Experience with cloud platforms (AWS, Azure, or GCP) and containerization (Docker, Kubernetes).
• Experience in model optimisation and data drift detection, model drift analysis, and automated retraining pipelines.
• Excellent communication and collaboration skills.

Responsibilities

• Configure platform integrations and manage LLM Ops stack components.
• Monitor LLM performance and detect drift using automated tools.
• Implement CI/CD pipelines for model deployment and testing.
• Collaborate with data scientists to ensure high-quality data feeds and pipelines.

Skills

LLM Ops

MLOps

AI infrastructure

monitoring tools

Python

AWS Bedrock

Docker

Kubernetes

Observability

Communication

Tools

Prometheus

Grafana

MLflow

Evidently AI

Hugging Face Transformers

Langfuse

Prometheus

Grafana

Evidently AI

DSQ

Job description

LLM Ops Engineer

Join to apply for the LLM Ops Engineer role at LSEG.

About The Role

We are seeking a skilled and proactive LLM Ops Engineer with expertise in Large Language Model (LLM) Operations to join our growing AI and software development team. This role is critical in ensuring the reliability, performance, and evolution of LLMs and data pipelines in production environments. You’ll understand the roles of Platform, AI Engineering, Governance and Product. Our technical stack includes tracing, annotations, experiments and plans to build a Data Science Workspace. You’ll help maintain the pipelines, experimentation platform and data science workspace, likely with tools such as Langfuse.

Responsibilities

• Data & System Integration
  • Configure platform integrations, manage LLM Ops stack components such as DSQ, Langfuse, and integrations for AI components.
  • Work with data scientists and engineers to ensure high‑quality, real‑time data feeds into LLM systems.
  • Build and maintain observability tools for data quality, model behaviour, and system health.
• Model Lifecycle Management
  • Manage deployment, versioning, and rollback of LLMs in production.
  • Coordinate and execute model upgrades with minimal service disruption.
  • Implement CI/CD pipelines for model deployment and testing.
• LLM Monitoring & Maintenance
  • Monitor LLM performance in production (latency, accuracy, user feedback).
  • Detect and address LLM drift and data drift using automated tools and custom metrics.
  • Collaborate with data scientists to refine model evaluation criteria.

Required Skills & Experience

• Proven experience in LLM Ops, MLOps, or AI infrastructure roles.
• Strong understanding of LLM behaviour, fine‑tuning, and prompt engineering.
• Experience with monitoring tools (Prometheus, Grafana, MLflow, Evidently AI).
• Experience with AWS Bedrock LLM models.
• Proficiency in Python and familiarity with ML frameworks such as Hugging Face Transformers and LangChain.
• Experience with cloud platforms (AWS, Azure, or GCP) and containerization (Docker, Kubernetes).
• Experience in model optimisation and data drift detection, model drift analysis, and automated retraining pipelines.
• Excellent communication and collaboration skills.

Desired Skills & Experience

• Experience working in agile software development environments.
• Knowledge of data privacy, model interpretability, and responsible AI practices.
• Contributions to open‑source LLM or MLOps projects.
• Experience in the finance sector and/or risk management.

Career Stage

Senior Associate

Company Overview

LSEG is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth. Our values—Integrity, Partnership, Excellence and Change—underpin our culture. We are proud to be an equal opportunities employer and we support sustainability across our business.

Benefits include healthcare, retirement planning, paid volunteering days and wellbeing initiatives. LSEG offers a range of tailored benefits and support.

We are an equal opportunities employer. We do not discriminate based on race, religion, colour, national origin, gender, sexual orientation, gender identity, expression, age, marital status, veteran status, pregnancy or disability, or any other basis protected under applicable law.

Contact: Please take a moment to read our privacy notice for information about personal data processing by LSEG.