Data Engineering Lead — Cloud Data Platform & Governance

London Stock Exchange; Greater London; On-site; GBP 70,000 - 90,000; Full time

Job summary

The London Stock Exchange is seeking a Senior Engineer to lead the Reporting & Data Analytics platform transformation to a cloud-native architecture. This role involves overseeing the technical direction, team leadership, and the design and implementation of robust data solutions.

Your experience should include data-centric solution development with SQL and Python, along with 15+ years in software engineering. You will work in a high-stakes regulatory environment, ensuring high availability and quality standards.

Qualifications

• Deep expertise in data engineering and data-centric solutions.
• 15+ years of hands-on software engineering experience with leadership roles.
• Experience in regulated, high availability environments.

Responsibilities

• Lead the reporting and data analytics transformation.
• Ensure platform stability during and after cloud migration.
• Act as a senior technical partner for governance bodies.

Skills

Data-centric solution development

SQL

PL/SQL

Python

Leadership

Data governance

Cloud architecture

Education

Degree in Computer Science or Software Engineering

Tools

Snowflake

Informatica PowerCenter

DataDog

Job description

• The Reporting & Data Analytics platform underpins regulatory reporting, risk visibility, member reporting and internal analytics across SwapClear and Listed Rates
• Given the scale, criticality and regulatory scrutiny of this data, the platform is subject to exacting availability, accuracy, lineage and governance requirements
• LCH has embarked on a strategic transformation of its Reporting & Data Analytics architecture, moving from legacy on-premise Oracle / Informatica stacks to a cloud native, Snowflake based data platform
• This solution will enable robust, performant reporting, self-service analytics, and new data distribution patterns for our members and clients
• Joining as a Senior Engineer, you will be accountable for setting the platform’s technical direction, delivering Reporting & Data Analytics features, and ensuring the ongoing stability of the platform during and beyond the transformation
• You will be a technology leader with deep hands-on data engineering experience, strong technical judgement, and the seniority to engage confidently with Group Architecture, Group Data Governance, and senior business partners
• You will lead a team of engineers to deliver the reporting and data analytics transformation, with responsibility for technical standards and professional development
• You will ensure the team designs and builds solutions in line with our Engineering Principles, taking a data-driven approach, innovating with purpose, and acting as an owner
• You will ensure the platform evolves beyond migration into a scalable, governed platform that supports our members and clients, and internal partners
• Technology owner of the end-to-end data solutions for reporting and data analytics across SwapClear and Listed Rates
• Lead the safe migration from legacy Oracle / Informatica platform to the target cloud architecture. Take accountability for successful legacy decommissioning, not just building the new platform
• Lead the design, implementation and multi-year phased delivery for SwapClear and Listed Rates
• Define and drive evolution of the Strategic Cloud data platform, ensure it is fit for purpose for SwapClear and Listed Rates use cases
• Ensure the E2E platform meets availability, performance, resilience and security expected of a “systemically important” clearing house
• Assists Product Owners and Delivery Leads with delivery planning of business goals/outcomes
• Act as a senior technical partner to Group Architecture Authority, Group Data Governance and Product and business partners
• Partner with Quality engineering to ensure that all aspects of the software development lifecycle is delivered to high levels of quality and using modern testing standards, automation and cloud-native practices
• Build and maintain strong relationships with internal and external partners, using influence and trust to drive alignment, resolve challenges, and promote shared quality goals

Deep expertise inSolid experience of data-centric solution using SQL, PL/SQL and PythonPrior experience working with Informatica PowerCenter or similar solutionsData warehouse modelling approachesImmutable, incremental and versioned data architecturesShown leadership of enterprise scale Snowflake (or similar) data platform implementationsQuality-first approachEnterprise scale data modellingPractical and relevant AI experience in data engineering / migrations use cases15+ years of hands-on software engineering experience, including at least 5+ years as a technical lead, with consistent track record of delivering high-quality solutionsELT data architectures, using dbt or similarStrong engineering background with the ability to engage deeply in design and implementationSeniority and credibility to influence group level architecture and governance bodiesCloud data lake and data warehouse solutionsPassionate about metrics driven approach and leading with dataData governance, lineage and control frameworksDetail oriented problem solver, comfortable “diving-deep”Experience operating in regulated, high availability environmentsDegree in Computer Science, Software Engineering or equivalentExperience of large-scale real-time and batch process orchestration, optionally with third-party orchestration enginesKnowledge and practical experience running technology both on prem and in cloudGood understanding of cyber security standards and practices and follows secure-by-design principleExperience of working with agile frameworks like Scrum, KanbanBackground working in financial industryExperience of modern observability platforms e.g. DataDog