Data Engineer: Lead Data Pipelines on Microsoft Fabric

The City of Edinburgh Council; Easter Howgate; On-site; GBP 48,000 - 56,000; Full time

Job summary

The City of Edinburgh Council is seeking a Data Engineer to partner with the Lead Data Engineer and design a high-impact data platform solution. This role will lead integration of multi-source sensor data into the Microsoft Fabric analytics platform and manage scalable data pipelines for critical projects across the Council.

You will design and maintain data infrastructure, ensure quality and governance, and collaborate with stakeholders to deliver data products that support strategic priorities

Qualifications

• Knowledge of designing, building, and maintaining data pipelines for analytics.
• Experience translating data requirements into technical solutions for cross-functional teams.
• Solid understanding of data models, schemas, and data storage for reporting.

Responsibilities

• Lead on projects to design and implement scalable, robust data pipelines to extract, transform, and load data into the Microsoft Fabric Platform.
• Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.
• Develop and maintain data models, schemas, and structures to optimise data storage and retrieval for analytics and reporting.
• Identify ways to improve data reliability, efficiency and quality across the Council's data systems.
• Work across the Council to extract, clean, integrate and store data as an asset for service delivery and decision making.
• Uphold data governance policies and standards, ensuring compliance with data privacy and security regulations.
• Document data engineering processes, workflows and specifications to facilitate knowledge sharing.

Skills

Data pipelines

ETL

Microsoft Fabric

Data modelling

Governance

Tools

Microsoft Fabric

Job description

The City of Edinburgh Council is seeking a Data Engineer to partner with the Lead Data Engineer and design a high-impact data platform solution. This role will lead integration of multi-source sensor data into the Microsoft Fabric analytics platform and manage scalable data pipelines for critical projects across the Council.

You will design and maintain data infrastructure, ensure quality and governance, and collaborate with stakeholders to deliver data products that support strategic priorities