Principal Data Engineer

OSB Group; Chatham; Hybrid; GBP 90,000 - 105,000; Full time

Benefits offered by this job

Annual discretionary bonus

30 days annual leave

Pension contributions

Enhanced family-focused benefits

Hybrid working

Job summary

OSB Group is seeking a Principal Data Engineer to act as the Azure Data Platform SME, providing architectural leadership and direction across data engineering initiatives. You will define, govern and deliver the target-state Azure Data Platform to enable trusted data, analytics, regulatory compliance and operational efficiency.

The role requires experience with Azure Data Lake Storage Gen2, Data Factory, Synapse Analytics, Databricks, SQL, and Event Hubs, plus data architecture, governance and

Qualifications

• Proven experience as a Data Solution Architect or Principal Data Engineer in regulated environment.
• Deep expertise in Microsoft Azure Data Platform services (Gen2, Data Factory, Synapse, Databricks, SQL, Event Hubs).
• Experience designing enterprise-scale data architectures, ETL/ELT, Lakehouse, batch & real-time processing.
• Strong Data governance, security, platform engineering, scalable & compliant data solutions.

Responsibilities

• Act as the senior Azure Data Platform expert providing technical leadership & governance.
• Define and deliver the target-state Azure Data Platform architecture.
• Architect scalable, secure Azure-based data solutions aligned with business objectives.
• Lead migration and modernization of legacy data warehouse/SQL Server environments.
• Mentor Data Engineers and promote DataOps, DevOps, CI/CD and IaC practices.

Skills

Azure data platform

Data architecture

Data governance

DataOps

DevOps

Tools

Azure Data Lake Storage Gen2

Azure Data Factory

Azure Synapse Analytics

Azure Databricks

Azure SQL

Event Hubs

Job description

About the team:

OSB Group is undertaking a significant transformation programme, building new cloud-based customer journeys and experiences supported by a modern enterprise data architecture. In parallel, the Group Data Office is responsible for maintaining a complex legacy data landscape that continues to run the bank today.

What you will be doing:

As a senior technical leader within the Data Engineering function, the Principal Data Engineer will act as the organisation's Azure Data Platform subject matter expert, providing architectural leadership and technical direction across all data engineering initiatives.

Working closely with the Head of Data Engineering, this role will define, govern and deliver the target-state Azure Data Platform, ensuring data solutions are scalable, secure, resilient and aligned to the organisation's data modernisation strategy. The successful candidate will bridge business objectives and technology delivery, driving the adoption of modern cloud-based data architectures that enable trusted data, advanced analytics, regulatory compliance and operational efficiency.

As the senior Azure expert within the team, the Principal Data Engineer will establish engineering standards, shape platform strategy, mentor engineers and provide authoritative guidance on best practices across data architecture, platform design, DataOps, governance and cloud engineering.

Your responsibilities will include…

• Act as the senior Azure Data Platform expert within the Data Engineering function, providing technical leadership, architectural governance and strategic direction across the organisation's data estate
• Partnering with the Head of Data Engineering to define, evolve and deliver the target-state Azure Data Platform architecture, supporting the organisation's data modernisation and cloud transformation strategy
• Leading the design and implementation of scalable, secure and resilient Azure-based data solutions that align with business objectives, enterprise architecture standards and regulatory requirements
• Architecting and delivering modern data platforms leveraging Azure technologies including Azure Data Lake Storage Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL and Event Hubs
• Designing and developing robust ETL/ELT frameworks, data pipelines, Lakehouse architectures and real-time data solutions, ensuring engineering excellence and reusability across the platform
• Establishing and governing enterprise data models, engineering standards, security controls, data quality frameworks, lineage and metadata management practices across the Azure Data Platform
• Leading the migration and modernisation of legacy data warehouse and SQL Server environments, driving adoption of cloud-native Azure services and best-practice engineering approaches
• Providing technical leadership, mentorship and guidance to Data Engineers while championing DataOps, DevOps, CI/CD and Infrastructure as Code practices to drive continuous improvement, platform optimisation and operational excellence

What's in it for you?

We offer a base salary depending on experience ranging from £90,000 to £105,000 per annum and a competitive benefits package including:

• Annual discretionary bonus opportunity
• 30 days annual leave
• Choose to contribute 3% or 5% pension, with employer contributions of 6% or 8% respectively
• Enhanced family-focused benefits
• Hybrid-working

Please use this link to see the fantastic benefits available at OSB: OSB Careers

About us:

At OSB Group, we understand how much our people bring to our organisation, which is why we try our best to give back too! Our Purpose is to help our customers, colleagues and communities prosper and we are on a transformation journey to become 'the bank of the future'.

Our commitment to professional development, flexible working, and employee well-being fosters a dynamic and supportive workplace.

Do you have the skills?

We are looking for talented individuals who have the experience and knowledge set out below:

• Proven experience as a Data Solution Architect, Principal Data Engineer, or similar senior-level role, with a track record of delivering Azure-based data solutions within a regulated environment
• Deep expertise in the Microsoft Azure Data Platform, including services such as Azure Data Lake Storage Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL and Event Hubs
• Extensive experience designing and implementing enterprise-scale data architectures, including data modelling, ETL/ELT frameworks, Lakehouse solutions, batch and real-time data processing, and cloud-native data platforms
• Strong understanding of data governance, security, architecture best practices and platform engineering, with experience implementing scalable, resilient and compliant data solutions
• Proven experience driving DataOps and DevOps practices within Agile environments, including CI/CD, Infrastructure as Code (Terraform/Bicep), automated testing, platform monitoring and cross-functional collaboration across Architecture, Engineering, Security and Infrastructure teams
• Certifications (preferred but not essential):
  • Microsoft Certified: Azure Solutions Architect Expert
  • Microsoft Certified: Azure Data Engineer Associate
  • Microsoft Certified: Azure AI Engineer Associate

We are proud to be a Disability Confident employer and are committed to creating an inclusive and accessible workplace where everyone can thrive.

We welcome applications from people of all backgrounds and encourage candidates with disabilities and long-term health conditions to apply.

If you meet the minimum criteria for the role and would like to be considered under our Disability Confident Scheme, please indicate this on your application.

Diversity, Equity & Inclusion

Our team value spending time together in the office, typically 3 days a week to support collaboration and connection with colleagues, but we're happy to have a conversation about what flexibility might look like for you.

Not sure if you meet all the criteria? Let us decide. Studies show that candidates from underrepresented backgrounds often feel they need to meet 100% of the criteria before applying. At OSB, we value the unique perspectives and experiences that diversity brings. We're committed to creating an inclusive space where everyone feels empowered to apply - even if you don't check every box.

We actively promote diversity at all levels, with Board-level Diversity Champions monitoring our progress. We're proud to be signatories of the Women in Finance Charter, supporting the growth of senior women in our sector. Our commitment extends to treating all employees and applicants equitably, ensuring fairness and respect for all.