Azure Data Engineer

British International Investment plc; Greater London; On-site; GBP 65,000 - 95,000; Full time

Job summary

British International Investment (BII) is seeking an Azure Data Engineer to join our Technology team and strengthen data engineering across integration, analytics, and reporting projects.

You will work with architects, developers and delivery teams to enhance the Azure data stack, implement end-to-end data pipelines, and support DevOps practices across Azure DevOps and Git.

Qualifications

• Proven record working with Azure relational and NoSQL databases, data warehouses, and SQL.
• Experience with ADLS, ADF, Microsoft Fabric, Azure SQL, PowerBI and end-to-end data pipelines.
• Strong background in building or enhancing CI/CD pipelines using Azure DevOps and GIT.
• Experience in transforming, preparing, and processing datasets for analytics.
• Scripting skills including YAML, PowerShell, Terraform, etc.
• Familiarity with testing tools and data platform validation.

Responsibilities

• Support analysis and design work for data platform projects and improve foundations.
• Deliver work for key business programs and promote adoption of data platform components.
• Coordinate changes across business and technology change management and incident processes.
• Communicate with project managers and technical teams to build trust and transparency.
• Ensure traceability of requirements from data through design, build, testing and scope changes.

Skills

Azure SQL

ADLS

ADF

PowerBI

Azure DevOps

GIT

Python/PySpark

Terraform

CI/CD pipelines

Data modelling

Education

Bachelor's degree in Computer Science or a related field

Tools

Azure

Microsoft Fabric

Terraform

Job description

British International Investment (BII)is the UK’s leading development finance institution, wholly owned by the UK Government. Our primary mission is to address global development challenges through strategic investments that promote sustainable and inclusive economic growth.

BII focuses on catalysing economic development, creating jobs, and building resilient economies in some of the world's most complex and underserved markets. We invest in businesses and projects that prioritise inclusive development, environmental sustainability, and innovation.

Our approach is characterised by rigorous investment standards, high governance principles, and a commitment to delivering measurable development impact. Our team consists of highly skilled and passionate professionals dedicated to making a tangible difference globally.

We foster a collaborative and intellectually stimulating work environment that values curiosity, innovation, and professional growth. Our culture balances high performance with a strong emphasis on wellbeing, ensuring our employees can achieve their full potential while contributing to our mission.

BII at a glance:

Over 75 yearssupporting sustainable business growth in developing and emerging markets

More than £9.9 billionin net assets

1,600+businesses invested in

950,000+workers in the businesses we support

650+people in our diverse global team

Team and role overview

• Over the years the Technology team has grown as the business has grown and evolved.
• The IT architecture teamis relatively smalland multifunctional.The technical environment is growing in complexity, in terms of business expectations, number of key systems supported and much needed integration of existing systems.
• BII has invested heavily in the Microsoft stack (Azure & M365), with most of the infrastructure in the Cloud.
• Most business solutions are 3rd party and all are hosted in the Cloud. There is little internal development however this may evolve toa more balanced model.
• We have a mix of hosted and SAAS products which are either standalone or integrated; there is a need to integrate more of our environment

Purpose

The Azure Data Engineer will work alongside a team of architects, developers, application support specialists and delivery teams to provide data engineering expertise in support of several major integration, data analytics and reporting projects.

You will also have engagement with teams to provide some level of support, training and continuously improve the Azure Data Stack in BII Technology as a whole. The Data Engineer also works closely with other IT production teams notably Platform Services and SharePoint/M365.

You will also be a key resource for the BII Enterprise Data Warehouse, and Azure Devops/git related work.

Responsibilities

As a Data Engineer, you will bring your experience in Azure data technologies to BII and your core responsibilities include:

• Supporting analysis and design work as required for projects and general data platform improvements.
• Actively delivering work for key business programs advising and supporting the further adoption of the data platform foundations.
• Coordinating changes across business change, technology change management process, incident management and problem management process.
• Communicating with project managers, and technical and business change teams to develop trust.
• Ensure traceability of requirements from Data through design, build, testing and scope changes.

The candidate

• Proven record working with Azure relational and NoSQL databases, data warehouses, query authoring (SQL) as well as working familiarity with a variety of databases.
• Highly experienced in working with data engineering technologies including ADLS, ADF, Microsoft Fabric, Azure SQL, PowerBI and can create E2E data processing pipelines.
• Highly experiences creating or enhancing CI/CD build and release pipelines using Azure DevOps and GIT.
• Experienced in building and optimizing data queries, manipulating, transforming, preparing and processing datasets.
• Experienced in working with Infrastructure as Code and scripting languages such as YAML, PowerShell, Terraform etc.
• Experienced in working with test tools and testing processes as they relate to a data platform.
• Good working knowledge of scripting languages such as Python/PySpark.
• A good understanding of data foundation concepts, such as data modelling, data quality management and data governance.

Competencies and aptitude

• Ability to quickly learn, implement, and utilise new technologies.
• Analytical and problem-solving. Combines and organises information into meaningful patterns; identifies underlying relationships, causes and effects; and combines pieces of information to form conclusions or general rules.
• Excellent oral and written communication skills.
• Detail-oriented. Consistently takes a thorough, accurate organised and quality-centred approach.
• Organisation and prioritising. Can effectively address projects, requests and competing priorities. Owning deliverables through to implementation.
• Self-learning mindset. Desires to learn new skills and is willing to share knowledge with the team.
• Provide problem diagnosis and technical assistance.

Candidates should be strongly motivated by BII’s development mission and ideally demonstrate some commitment to development or social goals through previous executive or non-executive activity.

Our cultural values

We look for team members who aspire, as we do, to work at our best and to be:

• Impact-led, commercially rigorous
• Tenacious in the face of challenges
• Collaborative and caring

British International Investment is committed to diversity and inclusion and welcomes all applicants regardless of age, disability, gender reassignment, marriage and civil partnership, pregnancy and maternity, race, religion or belief, sex, sexual orientation or educational background.