Data Engineering Lead

London Stock Exchange; Greater London; On-site; GBP 70,000 - 90,000; Full time

Job summary

The London Stock Exchange is seeking a Senior Engineer to lead the Reporting & Data Analytics platform transformation to a cloud-native architecture. This role involves overseeing the technical direction, team leadership, and the design and implementation of robust data solutions.

Your experience should include data-centric solution development with SQL and Python, along with 15+ years in software engineering. You will work in a high-stakes regulatory environment, ensuring high availability and quality standards.

Qualifications

• Deep expertise in data engineering and data-centric solutions.
• 15+ years of hands-on software engineering experience with leadership roles.
• Experience in regulated, high availability environments.

Responsibilities

• Lead the reporting and data analytics transformation.
• Ensure platform stability during and after cloud migration.
• Act as a senior technical partner for governance bodies.

Skills

Data-centric solution development

SQL

PL/SQL

Python

Leadership

Data governance

Cloud architecture

Education

Degree in Computer Science or Software Engineering

Tools

Snowflake

Informatica PowerCenter

DataDog

Job description

Responsibilities

• The Reporting & Data Analytics platform underpins regulatory reporting, risk visibility, member reporting and internal analytics across SwapClear and Listed Rates
• Given the scale, criticality and regulatory scrutiny of this data, the platform is subject to exacting availability, accuracy, lineage and governance requirements
• LCH has embarked on a strategic transformation of its Reporting & Data Analytics architecture, moving from legacy on‑premise Oracle / Informatica stacks to a cloud native, Snowflake based data platform
• This solution will enable robust, performant reporting, self‑service analytics, and new data distribution patterns for our members and clients
• Joining as a Senior Engineer, you will be accountable for setting the platform’s technical direction, delivering Reporting & Data Analytics features, and ensuring the ongoing stability of the platform during and beyond the transformation
• You will be a technology leader with deep hands‑on data engineering experience, strong technical judgement, and the seniority to engage confidently with Group Architecture, Group Data Governance, and senior business partners
• You will lead a team of engineers to deliver the reporting and data analytics transformation, with responsibility for technical standards and professional development
• You will ensure the team designs and builds solutions in line with our Engineering Principles, taking a data‑driven approach, innovating with purpose, and acting as an owner
• You will ensure the platform evolves beyond migration into a scalable, governed platform that supports our members and clients, and internal partners
• Technology owner of the end‑to‑end data solutions for reporting and data analytics across SwapClear and Listed Rates
• Lead the safe migration from legacy Oracle / Informatica platform to the target cloud architecture. Take accountability for successful legacy decommissioning, not just building the new platform
• Lead the design, implementation and multi‑year phased delivery for SwapClear and Listed Rates
• Define and drive evolution of the Strategic Cloud data platform, ensure it is fit for purpose for SwapClear and Listed Rates use cases
• Ensure the E2E platform meets availability, performance, resilience and security expected of a “systemically important” clearing house
• Assist Product Owners and Delivery Leads with delivery planning of business goals/outcomes
• Act as a senior technical partner to Group Architecture Authority, Group Data Governance and Product and business partners
• Partner with Quality engineering to ensure that all aspects of the software development lifecycle is delivered to high levels of quality and using modern testing standards, automation and cloud‑native practices
• Build and maintain strong relationships with internal and external partners, using influence and trust to drive alignment, resolve challenges, and promote shared quality goals

Qualifications

• Deep expertise in
• Solid experience of data‑centric solution using SQL, PL/SQL and Python
• Prior experience working with Informatica PowerCenter or similar solutions
• Data warehouse modelling approaches
• Immutable, incremental and versioned data architectures
• Showed leadership of enterprise‑scale Snowflake (or similar) data platform implementations
• Quality‑first approach
• Enterprise scale data modelling
• Practical and relevant AI experience in data engineering / migrations use cases
• 15+ years of hands‑on software engineering experience, including at least 5+ years as a technical lead, with consistent track record of delivering high‑quality solutions
• ELT data architectures, using dbt or similar
• Strong engineering background with the ability to engage deeply in design and implementation
• Seniority and credibility to influence group level architecture and governance bodies
• Cloud data lake and data warehouse solutions
• Passionate about metrics‑driven approach and leading with data
• Data governance, lineage and control frameworks
• Detail oriented problem solver, comfortable “diving‑deep”
• Experience operating in regulated, high availability environments
• Degree in Computer Science, Software Engineering or equivalent
• Experience of large‑scale real‑time and batch process orchestration, optionally with third‑party orchestration engines
• Knowledge and practical experience running technology both on prem and in cloud
• Good understanding of cyber security standards and practices and follows secure‑by‑design principle
• Experience of working with agile frameworks like Scrum, Kanban
• Background working in financial industry
• Experience of modern observability platforms e.g. DataDog