Senior Product Manager for AI Observability

London Stock Exchange Group; Greater London; On-site; GBP 120,000 - 180,000; Full time

Job summary

London Stock Exchange Group is seeking a Senior Product Manager—AI Observability to own the strategy and rollout of telemetry systems that monitor AI models, MCPs, and AI-enabled features across LSEG products.

You will define data schemas, instrumentation standards, and dashboards, partnering with platform engineering and governance teams to ensure compliance, reliability and cost efficiency. This role requires collaboration across risk, legal and compliance, engineering, and business units.

Qualifications

• Experience in product management with observability, telemetry, data platforms or SRE‑driven products.
• Knowledge of LLMs, embeddings, vector search, MCP tools, and AI inference workflows.
• Deep familiarity with logging, tracing, metrics, and event‑based telemetry systems.
• Ability to define data schemas, signal taxonomies and data contracts.
• Analytical skills to derive insights from large‑scale system telemetry.
• Experience with senior engineering, data science, risk and governance stakeholders.
• Familiarity with BI tools and use of enterprise data workflows.

Responsibilities

• Define end‑to‑end telemetry vision and roadmaps for LLMs, MCPs and AI experiences.
• Establish standardized telemetry schemas across business lines.
• Partner with platform engineering for scalable instrumentation.
• Identify key signals for quality, latency, cost and user workflow insights.
• Own dashboards, monitoring tools and performance scorecards.
• Enable self‑service insights for product and engineering teams.
• Collaborate with AI Governance, Risk, Legal, and Compliance on telemetry.

Skills

Observability

Telemetry

Product management

SRE/DevOps

AI governance

Tools

Dashboards

Monitoring tools

Model comparison views

Job description

Role Profile

As part of the LSEG AI, we are hiring a Senior Product Manager–AI Observability to own the strategy, design and rollout of telemetry systems that monitor, measure and analyse how AI models, MCPs, and AI-enabled features behave across all LSEG products. This role is responsible for defining how we collect, structure, analyse and act on AI‑specific telemetry signals—including prompt patterns, model performance, MCP call usage, latency, error conditions, cost metrics, user behaviour signals, and system reliability. You will develop a telemetry foundation that supports AI governance&risk model performance tracking cost efficiency user experience optimisation operational reliability auditability and the long‑term evolution of our AI platform.

Key Responsibilities & Accountabilities

Telemetry & Observability Strategy

Define the end‑to‑end telemetry vision and roadmap for LLMs, MCPs, vector stores, embeddings, inference layers and AI‑powered user experiences.

Establish a standardised telemetry schema for capturing prompts, tool calls, model responses, durations, errors, confidence signals, and quality indicators across business lines.

Partner with platform engineering to ensure instrumentation is consistent, scalable and compliant.

Signal Design & Data Architecture

Identify key signals required for:

• Quality & reliability
• Latency & throughput
• Cost tracking & optimisation
• MCP usage patterns
• User workflow insights
• Failure pattern detection
• Guardrail and safety event monitoring

Define retention rules, PII considerations, anonymisation and usage policies in partnership with AI Governance and Compliance.

Platform & Tooling

Own requirements for dashboards, monitoring tools, model comparison views, anomaly detection alerts, and performance scorecards.

• dashboards
• monitoring tools
• model comparison views
• anomaly detection alerts
• performance scorecards

Design systems that allow product and engineering teams to self‑serve insights about AI model behaviour and MCP interactions.

Partner with engineering to build pipelines that support real‑time and batch analytics.

Cross‑Functional Collaboration

Collaborate with product owners across LSEG to instrument their AI features consistently.

Partner with AI Evaluation PM (previous role), Model Risk, GSSR, Legal and Compliance to align telemetry with governance frameworks.

Work closely with Engineering and SRE teams to drive observability improvements and reliability engineering for AI systems.

Optimisation & Insights

Identify cost inefficiencies across model and MCP usage, and drive recommendations to improve ROI.

Surface workflow‑level insights on how customers use AI features—informing product roadmaps.

Partner with product leaders across divisions to understand how telemetry can improve customer experience, reliability and performance.

Governance & Standards

Define and maintain AI telemetry standards and best practices across all LSEG divisions.

Contribute to LSEG’s AI governance and Responsible AI initiatives by providing data‑driven insights on model behavior and user impact.

Ensure telemetry systems support auditability, compliance and explainability requirements.

Skills & Competencies Required

• Experience in product management with a strong foundation in observability, telemetry, data platforms, monitoring, or SRE / DevOps‑driven products.
• Understanding of LLMs, embeddings, vector search, MCP tools, and AI inference workflows.
• Deep familiarity with logging, tracing, metrics, and event‑based telemetry systems.
• Ability to define data schemas, signal taxonomies, aggregation strategies and data contracts.
• Strong analytical skills and ability to derive insights from large‑scale system telemetry.
• Experience working with senior engineering, data science, risk and governance stakeholders.
• Preferred Exposure to financial data, analytics systems and enterprise‑scale data workflows.
• Familiarity with BI tools, metrics stores, distributed tracing and monitoring stacks.
• Understanding of cloud infrastructure, serverless runtimes, API gateways and model hosting architectures.
• Ability to drive cross‑functional alignment and establish group‑wide standards.

Measures of Success

Platform Reliability & Performance

• Reduction in AI system error rates, latency spikes and operational incidents.
• Stability and transparency of MCP usage across product lines.
• Quality and coverage of telemetry signals across all AI‑enabled products.

Insight Generation & Adoption

• Adoption of telemetry dashboards and self‑service tools across divisions.
• Number of identified and resolved model or MCP reliability issues driven by telemetry.
• Level of insight generated to influence product prioritisation and AI model choices.

Operational Efficiency & Cost

• Improved cost transparency and cost‑saving impact via telemetry‑driven optimisation.
• Reduction in unnecessary model invocation or inefficient tool usage.

Governance & Compliance

• Contribution to Responsible AI frameworks through robust, auditable telemetry.
• Improved explainability and traceability of AI features for internal/external stakeholders.

LSEG Information

Join us and be part of a team that values innovation, quality, and continuous improvement. If you're ready to take your career to the next level and make a significant impact, we'd love to hear from you. LSEG is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth. Our purpose is the foundation on which our culture is built. Our values of Integrity, Partnership, Excellence and Change underpin our purpose and set the standard for everything we do, every day. They go to the heart of who we are and guide our decision making and everyday actions. Working with us means that you will be part of a dynamic organisation of 25,000 people across 65 countries. However, we will value your individuality and enable you to bring your true self to work so you can help enrich our diverse workforce. We are proud to be an equal opportunities employer. This means that we do not discriminate on the basis of anyone’s race, religion, colour, national origin, gender, sexual orientation, gender identity, gender expression, age, marital status, veteran status, pregnancy or disability, or any other basis protected under applicable law. Conforming with applicable law, we can reasonably accommodate applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. You will be part of a collaborative and creative culture where we encourage new ideas. We are committed to sustainability across our global business and we are proud to partner with our customers to help them meet their sustainability objectives.

LSEG offers a range of tailored benefits and support, including healthcare, retirement planning, paid volunteering days and wellbeing initiatives.

Please take a moment to read this privacy notice carefully, as it describes what personal information London Stock Exchange Group (LSEG) (we) may hold about you, what it’s used for, and how it’s obtained, your rights and how to contact us as a data subject.

LSEG is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth. Our culture of connecting, creating opportunity and delivering excellence shapes how we think, how we do things and how we help our people fulfil their potential. Our Data & Analytics, Capital Markets and Post Trade divisions have a combined power that provides a comprehensive, integrated suite of trusted financial market infrastructure services to help our customers pursue their ambitions. Explore our divisions LSEG is headquartered in the United Kingdom, with significant operations in 70 countries across Europe, the Middle East, Africa, North America, Latin America and Asia Pacific.