Lead Data Quality Engineer (Azure Fabric)

The Ebrd; City of Westminster; Hybrid; GBP 70,000 - 90,000; Full time

Job summary

A prominent international financial institution in the UK is seeking a Principal Quality Engineer to lead the quality engineering strategy for data platforms. The role emphasizes integrating quality checks in CI/CD pipelines, using expertise in T-SQL, Python, and Azure Data Factory. The ideal candidate thrives in a fast-paced environment focused on data analytics and automation, contributing to high-stakes projects and ensuring robust dataflows.

Benefits

Flexible working arrangements

Comprehensive benefits package

Diverse, inclusive work environment

Qualifications

• Experience in Quality Engineering management and operations within an agile, product-focused IT department.
• Proficient in writing testing queries in T-SQL/Python for data validation.
• Demonstrates comprehensive QA leadership across advanced automation.

Responsibilities

• Lead quality engineering strategy and execution for data platforms.
• Integrate Agile and DevOps principles across data integration pipelines.
• Implement regression testing and data comparison across multi-environment pipelines.

Skills

T-SQL

Python

Azure Data Factory

Power Query (M)

DAX

XMLA

AI/ML approaches

Data Analytics

Test management

Agile methodologies

Education

ISTQB Advanced Test Manager certification

ITIL v4 Foundation

Tools

Azure DevOps

Informatica

SAP HANA

Job description

Own the quality frontier of data and analytics. We're seeking a Principal Quality Engineer for Data & Analytics to lead quality engineering strategy and execution across next‑generation data platforms. In this role, you'll embed quality at the core of Microsoft Fabric, Azure Integration Services, IDMC and Tibco EBX, weaving automated data validation, lineage checks, and regression testing directly into CI/CD pipelines. You'll pressure‑test resilience with failover scenarios, validate mission‑critical dataflows, and ensure that every pipeline, from raw ingestion to business‑ready insights, is robust, reliable, and built for scale. This is your opportunity to set the bar for quality engineering in enterprise analytics. You'll apply advanced automation, AI/ML‑driven assurance, and shift‑left/shift‑right practices to accelerate delivery without compromising control. Leveraging T‑SQL, Python, Playwright, Postman, PySpark, Power Query (M), DAX, XMLA, Fabric Notebooks, Delta Lake, Fabric Data Pipelines, Azure Data Factory, Data Pipelines, Azure DevOps CI/CD, and REST/Graph APIs, you'll bring deep technical expertise while aligning to frameworks like NIST CSF, DORA, and ITIL v4. If you thrive at the intersection of data, DevOps, and quality engineering, and want to shape the reliability of modern Data and Analytics ecosystems in a fast‑moving, high‑stakes environment, this role will give you the chance to leave your mark.

Accountability and Responsibility

• Integrates Agile and DevOps principles across data integration pipelines, aligning with ITIL v4 and DataOps for quality‑centric operational delivery in enterprise analytics ecosystems.
• Embeds data quality checks and lineage validation directly into CI/CD workflows using Azure DevOps pipelines for Azure Data Factory (ADF), Informatica Intelligent Cloud Services (IICS), and SAP HANA native development.
• Implements regression testing and data comparison strategies across multi‑environment ADF pipelines and Informatica mappings, including use of snapshot‑based reconciliation for critical data flows into SAP HANA.
• Applies resilience and failover validation scenarios to critical dataflows, including simulated connector outages, queue backlogs, and timeout conditions in ADF and Informatica to ensure business continuity and alert responsiveness.
• Holds ISTQB Advanced Test Manager or an equivalent recognised certification in test management, or demonstrable experience.
• Qualification in IT Service Management, such as ITIL v3 or v4 Foundation or equivalent.
• Familiar with NIST cybersecurity framework (CSF) and EU Digital Operational Resilience Act (DORA).
• Demonstrates comprehensive QA leadership across advanced automation, performance, shift‑left, or shift‑right testing.
• Demonstrable experience in Quality Engineering management and operations within an agile, product focused IT department, ideally within a financial institution.
• Experienced in advanced AI/ML approaches for improving quality efficiency and effectiveness, analytics, defect identification, understanding how AI can enhance quality processes.
• Demonstrable experience in testing data platform configuration and setup, data feeds, inputs and outputs from a modern Data Analytics platform based on MS Fabric “Medallion Architecture” and Azure Data Lake Gen2, alongside more traditional SQL / Datawarehouse skills.
• Extensive experience in testing and validation of code requiring dev level T‑SQL, Python, Azure Data Factory, PowerQuery (M), XMLA, DAX skills will be required.
• Proficiency in writing testing queries in T‑SQL / Python for data validation purposes, ability to run Data Factory Pipelines / Data flows (Gen2) and DAX / XMLA for Tabular model data validation / testing would be mandatory.
• Experienced in testing Data Platforms and Data Engineering solutions on Microsoft Intelligent Data Platform including Microsoft Fabric experience, Azure Databricks, Agile delivery (ideally Azure DevOps).
• Extensive experience as a technical testing specialist with MS Data Engineering and ideally Power BI / Analytics skills.

Our agile and innovative approach is what makes life at the EBRD a unique experience! You will be part of a pioneering and diverse international organisation, and use your talents to make a real difference to people's lives and help shape the future of the regions we invest in.

At EBRD, our Values – Inclusiveness, Innovation, Trust, and Responsibility – are at the heart of how we work. We bring these to life through our Workplace Behaviours: listening well and speaking up, collaborating smartly, acting decisively with full commitment, and simplifying to amplify our impact. These principles shape our culture and define our success. We seek individuals who not only share these values but are also committed to embedding them in their daily work, fostering a positive and high‑performing environment.

The EBRD environment provides you with:

• Varied, stimulating and engaging work that gives you an opportunity to interact with a wide range of experts in the financial, political, public and private sectors across the regions we invest in.
• A working culture that embraces inclusion and celebrates diversity. Our workforce reflects a broad range of backgrounds, perspectives, and experiences, bringing fresh ideas, energy, and innovation and enhancing our ability to serve our clients, shareholders, and counterparties effectively.
• We offer hybrid and flexible working arrangements and believe we operate at our best when collaborating 3 days a week in person (minimum).
• An environment that places sustainability, equality and digital transformation at the heart of what we do.
• A workplace that prioritises employee wellbeing and provides a comprehensive suite of competitive benefits.

Diversity is one of the Bank's core values which are at the heart of everything it does. As such, the EBRD seeks to ensure that everyone is treated with respect and given equal opportunities and works in an inclusive environment. The EBRD encourages all qualified candidates who are nationals of the EBRD member countries to apply regardless of their racial, ethnic, religious and cultural background, gender, gender identity, sexual orientation, age, socio‑economic background or disability.