Senior Data Engineer

OSB Group; West Midlands; Hybrid; GBP 55,000 - 70,000; Full time

Benefits offered by this job

Annual discretionary bonus up to 17.5%

30 days annual leave

Pension with employer contributions

Enhanced family-focused benefits

Hybrid-working

Job summary

OSB Group in the United Kingdom is seeking a Senior Data Engineer to deliver and implement data solutions using the Microsoft SQL stack and Azure cloud services as part of the Data Transformation programme.

You will build complex pipelines, data warehouses and data lakes with Azure Data Factory, Synapse and Databricks, mentor colleagues, and help modernise data platforms while working in a hybrid model.

Qualifications

• Extensive data engineering and ETL development experience in regulated environments.
• Experience designing MI/BI analytics solutions (Kimball, lake house, data lake).
• Proficiency in Python, SQL, SparkSQL and PySpark.
• Strong Azure delivery experience across analysis, development, configuration and deployments.
• Expert Transact-SQL and relational database skills.

Responsibilities

• Lead design, development, delivery and maintenance of on-premises SQL and Azure data solutions.
• Implement robust ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines and Azure Databricks.
• Design real-time and batch ingestion using Azure Event Hubs, Kafka and Databricks Structured Streaming.
• Develop and maintain Delta Lake/Lakehouse on ADLS Gen2 and Azure Synapse.
• Mentor colleagues on data engineering best practices.

Skills

Data engineering & ETL

Python/SQL/SparkSQL/PySpark

Azure cloud platforms

SQL (Transact-SQL)

MI/BI analytics design

Tools

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Databricks Spark

Job description

The key purpose of this role is to deliver new, and implement changes to existing data solutions, data extraction and transform (ETL), using the full Microsoft SQL stack, for identified and agreed business requirements.

In addition, the Senior Data Engineer will be responsible for translating business requirements into Azure Cloud-based big data solutions for our Data Transformation programme. This will include building complex data pipelines, data warehouses and the data lakes, using Azure services such as Azure Data Factory, Azure Data Bricks and Azure Synapse Analytics.

Your responsibilities will include…

• Leading the design, development, delivery and maintenance of technical on-premises SQL and Azure Cloud data engineering solutions, ensuring alignment with business priorities and best practice
• Implementing robust ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines and Azure Databricks (PySpark/Spark SQL) to support batch and streaming data processing
• Designing and delivering real-time and batch data ingestion solutions using Azure Event Hubs, Kafka, Databricks Structured Streaming and Azure Stream Analytics
• Developing and maintaining modern data platforms, including Delta Lake/Lakehouse architectures on ADLS Gen2, curated datasets, dimensional models and Azure Synapse Dedicated SQL Pools
• Analysing current business practices, processes and procedures, identifying opportunities to leverage Microsoft Azure Data & Analytics Services to improve business outcomes and data processing efficiency
• Maintaining the integrity of data architecture, championing high-quality data standards and the effective use of data repositories, relational models and data warehouse solutions to deliver accurate, consistent and reliable data
• Designing and delivering performance enhancements, application migrations, version upgrades and data platform modernisation initiatives, including migrations from on-premises to public cloud environments
• Championing and mentoring colleagues on Data Engineering best practices, while developing reusable code, libraries, patterns and frameworks for Azure cloud-based data warehousing and data pipelines
• Contributing to the development and continuous improvement of database management services, processes and standards relating to the delivery of data solutions

What's in it for you?

We offer a competitive base salary depending on experience from £55,000 to £70,000 and a competitive benefits package including:

• Annual discretionary bonus opportunity: up to 17.5%
• 30 days annual leave
• Choose to contribute 3% or 5% pension, with employer contributions of 6% or 8% respectively
• Enhanced family-focused benefits
• Hybrid-working

Please use this link to see the fantastic benefits available at OSB: OSB Careers

About us:

At OSB Group, we understand how much our people bring to our organisation, which is why we try our best to give back too! Our Purpose is to help our customers, colleagues and communities prosper and we are on a transformation journey to become 'the bank of the future'.

Our commitment to professional development, flexible working, and employee well-being fosters a dynamic and supportive workplace.

Do you have the skills?

We are looking for talented individuals who have the experience and knowledge set out below:

• Extensive experience with Data Engineering / ETL development experience is essential with a regulated environment is essential
• Significant experience with data solution design experience in an MI / BI / Analytics environment (Kimball, lake house, data lake) is essential
• Proficiency in Python/SQL/SparkSQL/PySpark is essential
• Strong experience of Azure delivery experience including analysis / development / configuration/ deployments essential
• Expert level technical skill set in as Transact SQL language and relational databases is essential

Next steps:

If this sounds like you, please apply now! For internal applications please visit the internal careers page to apply.

Still on the fence? Hear from our team or explore our process: OSB Careers

Shortlisted candidates will go through a personalised recruitment process, that is relevant and conversational. If you need any adjustments or support, we're here to make sure you can show your best self.

Interested? Apply now! Still considering? Hear from our team or learn more about our recruitment process: OSB Careers

We believe in a personalised and inclusive approach, ensuring the process is relevant and conversational. If you need any adjustments or support, we're here to make sure you can show your best self.

We are proud to be a Disability Confident employer and are committed to creating an inclusive and accessible workplace where everyone can thrive.

We welcome applications from people of all backgrounds and encourage candidates with disabilities and long-term health conditions to apply.

If you meet the minimum criteria for the role and would like to be considered under our Disability Confident Scheme, please indicate this on your application.

Diversity, Equity & Inclusion

Our team value spending time together in the office, typically 3 days a week to support collaboration and connection with colleagues, but we're happy to have a conversation about what flexibility might look like for you.

Not sure if you meet all the criteria? Let us decide. Studies show that candidates from underrepresented backgrounds often feel they need to meet 100% of the criteria before applying. At OSB, we value the unique perspectives and experiences that diversity brings. We're committed to creating an inclusive space where everyone feels empowered to apply - even if you don't check every box.

We actively promote diversity at all levels, with Board-level Diversity Champions monitoring our progress. We're proud to be signatories of the Women in Finance Charter, supporting the growth of senior women in our sector. Our commitment extends to treating all employees and applicants equitably, ensuring fairness and respect for all.