Senior Data Engineer

Nigel Wright Recruitment; Remote; GBP 60,000 - 80,000; Full time

Job summary

A prominent recruitment agency is seeking a Senior Data Engineer for the Institute of Directors. In this remote role, you will lead data engineering efforts to develop a next-generation data platform, ensuring business leaders can access timely and accurate information. Your expertise in data warehousing, Microsoft Stack, and governance practices will be crucial. Strong communication skills are necessary for engaging with non-technical stakeholders. Occasional travel to the London HQ is required, and candidates must have the right to work in the UK.

Qualifications

• Strong experience in data engineering, particularly in data warehousing.
• Track record of establishing data governance best practices.
• Comfortable working in the Microsoft Stack.

Responsibilities

• Develop and maintain the data warehouse in Fabric.
• Integrate data from multiple sources.
• Ensure data quality and governance processes are implemented.
• Monitor and optimise data pipeline performance.
• Liaise with business and IT stakeholders.

Skills

Data governance best practices

Communication skills

Python

ETL processes

Microsoft Stack (Fabric, Azure, Power BI)

Tools

Fabric

Azure

Power BI

DBT

Job description

The Company

Nigel Wright are delighted to be partnering with the Institute of Directors in their search for a Senior Data Engineer.

The Institute of Directors (IoD) is a thriving membership community for Directors in the UK and beyond, where you can connect with other leaders, develop your skills and be heard. The IoD offers professional development, valuable connections and influence. With over 20,000 members across the UK and globally, the IoD has exciting plans for growth and the success of their strategy is underpinned by technology. Working in a newly created role, the Senior Data Engineer will be instrumental in designing, developing and maintaining their next generation data platform, ensuring business leaders have timely and accurate information to drive growth and efficiency.

You will be employed on a remote contract with occasional travel to their HQ in London. Unfortunately the IoD is unable to sponsor visas so candidates must have a permanent right to work in the UK.

The Role

Acting as a Technical Lead for data engineering within a small IT team you will :

• Develop and maintain the data warehouse (currently in Fabric)
• Integrate data from multiple sources (internal systems, external datasets)
• Ensure data quality, cleansing and governance processes are implemented
• Monitor, troubleshoot and optimise data pipeline and data warehouse performance to ensure high availability and efficiency
• Liaise closely with business and IT stakeholders, including directors and senior leadership
• Assist in defining technical requirements for new systems and integrations

The Requirements

You will have strong experience in data engineering, with a particular focus on data warehousing and data lake technologies. Additionally you will have a track record of establishing data governance best practises, including data security, data quality and data lineage. Other requirements include :

• Comfortable working in Microsoft Stack (Fabric, Azure, Power BI)
• Knowledge of ETL processes, semantic layers and tools like DBT
• Proficiency in Python for data manipulation and automation
• Ability to challenge assumptions and educate senior staff on data possibilities
• Strong communication skills to engage with non-technical stakeholders