Data Engineer

Bank of England; Leeds; Hybrid; GBP 40,000 - 80,000; Full time

Job summary

An established industry player is seeking a mid-level Data Engineer to join their innovative Data Engineering team. In this dynamic role, you will design and build scalable data pipelines, leveraging cutting-edge Azure technologies to support critical banking functions. Your expertise will be essential in ensuring data accuracy and availability for business intelligence and analytics. This role offers a unique opportunity to work in a collaborative environment, where your contributions will directly impact the Bank's mission of financial stability and regulatory supervision. If you're passionate about data engineering and eager to make a difference, this is the perfect opportunity for you.

Benefits

Comprehensive benefits package

Private medical insurance

Pension plan

Annual leave

Flexible working arrangements

Qualifications

• Experience in designing and deploying scalable data architectures.
• Proficient in data ingestion and transformation using Azure services.

Responsibilities

• Develop and maintain data pipelines on the Bank's cloud platform.
• Collaborate with teams to translate requirements into data solutions.

Skills

Python

PySpark

SQL

Azure Databricks

Data Engineering

CI/CD

Linux/Unix

Data Modelling

Education

Bachelor's Degree in Computer Science or related field

Tools

Azure Data Lake Storage

Azure Data Factory

Apache Airflow

Cloudera Manager

Job description

Join to apply for the Data Engineer role at Bank of England

Join to apply for the Data Engineer role at Bank of England

Get AI-powered advice on this job and more exclusive features.

This range is provided by Bank of England. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

About Us

We are Data Services, our mission is to unlock the value of data by delivering high-quality, reliable, and secure data services that are accessible, understandable, and actionable. We continuously evolve our offerings, leveraging modern cloud-based technologies, and fostering strong partnerships to help our colleagues in the Bank navigate the complexities of a data-driven world and achieve their strategic objectives.

Job Description

The world of data in Central Banking is evolving rapidly. With the rise of detailed data collection in financial regulation and the swift advancements in cloud-native data technologies, the demand for skilled data engineers is growing. We're on the lookout for a mid-level Data Engineer to join our Data Engineering team. In this role, you'll help design, build, and support data pipelines on the Bank's strategic cloud-first data platform! Your work will play a crucial role in supporting the Bank's core responsibilities around monetary policy, financial stability, and regulatory supervision.

Role Requirements

• Design, develop, test, and deploy scalable, cost-effective, and secure distributed architectures using Azure services such as Azure Databricks and Azure Data Lake Storage.
• Use Databricks to ingest, transform, and load data into modern data platforms.
• Write efficient, scalable code using Python and PySpark, optimizing for performance in Azure Databricks and on-premise systems where applicable.
• Ensure data is fit-for-purpose, accurate, and available in a timely manner for business intelligence, analytics, and operational use cases.
• Monitor and optimize existing data pipelines, both cloud-native and legacy, to enhance performance, reliability, and maintainability, while minimizing impact on business operations.
• Prototype and implement modern data engineering approaches using Azure-native tools and Delta Lake, contributing to a culture of innovation and continuous improvement.
• Mentor and guide junior engineers, sharing expertise in data engineering best practices, particularly in Azure and distributed data processing using Spark.
• Work closely with business users and analysts to translate requirements into scalable data solutions using both cloud and on-prem components.
• Stay informed of emerging technologies and trends in data engineering, particularly within the Azure ecosystem and Databricks platform.
• Lead and contribute to the migration of existing data infrastructure to Azure, ensuring smooth transitions, minimal disruption, and long-term scalability.
• Collaborate cross-functionally with architects, analysts, and stakeholders to align on data strategy and ensure the interoperability of Azure-based and legacy systems.
• Experience with Azure services such as Azure Databricks, Azure Data Lake Storage, and Azure Data Factory.
• Expertise in SQL.
• Experience using Python and Spark.
• Experience using CI/CD methodology with industry-standard tools.
• Work with testing team to ensure pipelines are tested thoroughly.
• Linux or Unix navigation skills.
• Understanding of standard methodologies for development and use of source control, preferably experience with Git.
• Self-driven with a passion for learning new technologies and skills.
• Experience delivering data pipelines on Hortonworks/Cloudera on-prem.
• Familiarity with:
  • Apache Airflow and Atlas
  • Cloudera Manager
  • Migration of existing platform to cloud
  • Data modelling

Our Approach to Inclusion

The Bank values diversity, equity and inclusion. We play a key role in maintaining monetary and financial stability, and to do that effectively, we believe we need a workforce that reflects the society we serve.

At the Bank of England, we want all colleagues to feel valued and respected, so we're working hard to build an inclusive culture which supports people from all backgrounds and communities to be at their best at work. We celebrate all forms of diversity, including (but not limited to) age, disability, ethnicity, gender, gender identity, race, religion, sexual orientation and socioeconomic status. We believe that it's by drawing on different perspectives and experiences that we'll continue to make the best decisions for the public.

We welcome applications from individuals who work flexibly, including job shares and part time working patterns. We've also partnered with external organisations to support us in making adjustments for candidates and employees in the recruitment process where they're needed.

For most roles where work can be carried out at home, we aim for colleagues to spend half of their time in the office, with a minimum of 40% per month. Subject to that minimum requirement, individuals and managers should work together to find what works best for them, their team and stakeholders.

Finally, we're proud to be a member of the Disability Confident Scheme. If you wish to apply under this scheme, you should check the box in the 'Candidate Personal Information' under the 'Disability Confident Scheme' section of the application.

Salary and Benefits Information

We encourage flexible working, part time working and job share arrangements. Part time salary and benefits will be on a pro-rated basis as appropriate.

We offer a salary as follows:

In addition, we also offer a comprehensive benefits package as detailed below:

• A non-contributory, career average pension giving you a guaranteed retirement benefit of 1/95th of your annual salary for every year worked. There is the option to increase your pension (to 1/50th) or decrease (to 1/120th) in exchange for salary through our flexible benefits programme each year.
• A discretionary performance award based on a current award pool.
• A 8% benefits allowance with the option to take as salary or purchase a wide range of flexible benefits.
• 26 days' annual leave with option to buy up to 12 additional days through flexible benefits.
• Private medical insurance and income protection.

National Security Vetting Process

Employment in this role will be subject to the National Security Vetting clearance process (and typically can take between 6 to 12 weeks post offer) and the passing of additional Bank security checks in accordance with the Bank policy. Further information regarding the vetting and security clearance requirements for the role will be provided to the successful applicant, and information about how the Bank processes personal data for these purposes, is set out in the Bank's Privacy Notice.

The Bank of England welcomes applications from all candidates, but as a UK Visas and Immigration (UKVI) approved sponsor, we have a responsibility to comply with the Immigration Rules and guidance. As such, our ability to employ individuals who require sponsorship for immigration purposes is limited. The Bank cannot guarantee that you and / or the role you are applying for will be eligible for sponsorship and that any application made to UKVI will be successful. Eligibility will therefore be considered on a case by case basis.

The Application Process

Important: Please ensure that you complete the 'work history' section and answer ALL the application questions fully. All candidate applications are anonymised to ensure that our hiring managers will not be able to see your personal information, including your CV, when reviewing your application details at the screening stage. It's therefore really important that you fill out the work history and application form questions, as your answers will form a critical part of the initial selection process.

This role closes on 22 May 2025.

The assessment process will comprise of two interview stages.

Please apply online, ensuring that you complete your work history and answer ALL the application questions fully and in detail as your application will not be considered if all mandatory questions are not fully completed.

Seniority level

• Seniority level

  Entry level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Technology, Information and Internet

Referrals increase your chances of interviewing at Bank of England by 2x

Sign in to set job alerts for “Data Engineer” roles.

Leeds, England, United Kingdom 1 month ago

Leeds, England, United Kingdom 3 weeks ago

Leeds, England, United Kingdom 1 week ago

Leeds, England, United Kingdom 1 month ago

Leeds, England, United Kingdom 3 weeks ago

Leeds, England, United Kingdom 3 weeks ago

Leeds, England, United Kingdom 1 week ago

Leeds, England, United Kingdom 1 month ago

Leeds, England, United Kingdom 1 month ago

Leeds, England, United Kingdom 2 months ago

South Yorkshire, England, United Kingdom 1 month ago

Huddersfield, England, United Kingdom 1 month ago

Leeds, England, United Kingdom 2 weeks ago

Leeds, England, United Kingdom 1 week ago

Leeds, England, United Kingdom 1 month ago

Leeds, England, United Kingdom 2 weeks ago

Leeds, England, United Kingdom 2 hours ago

York, England, United Kingdom 1 month ago

Leeds, England, United Kingdom 3 weeks ago

Bradford, England, United Kingdom 1 week ago

Leeds, England, United Kingdom 4 hours ago

South Yorkshire, England, United Kingdom 2 weeks ago

Leeds, England, United Kingdom 3 weeks ago

Leeds, England, United Kingdom 2 weeks ago

Leeds, England, United Kingdom 6 days ago

Leeds, England, United Kingdom 4 days ago

Leeds, England, United Kingdom 1 week ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.