Senior Data Engineer - West Yorkshire - £80k

Exalto Consulting; Yorkshire (VA); Hybrid; USD 93,000 - 106,000; Full time

Job summary

Exalto Consulting is seeking a Senior Data Engineer with strong hands-on Microsoft Fabric experience to design and build a modern data platform supporting analytics, AI and operational use cases.

The role focuses on end-to-end ETL/ELT pipelines, Lakehouse architectures and CI/CD for data solutions, with hybrid working in West Yorkshire, 2 days onsite.

Qualifications

• Strong commercial experience with Microsoft Fabric.
• Hands-on experience with Dataflow Gen2, Fabric Notebooks and Lakehouse architecture.
• Strong SQL and Python skills.
• Experience with Spark and Spark SQL.
• Proven experience designing scalable ETL and ELT pipelines.
• Data Lake and Delta Lake experience.
• Experience integrating data from multiple structured and unstructured sources.
• Good understanding of CI/CD, DevOps and modern data engineering practices.

Responsibilities

• Design and build end to end ETL and ELT solutions using Microsoft Fabric.
• Build scalable data pipelines using Dataflow Gen2 and Fabric Notebooks.
• Develop and maintain Lakehouse solutions using Medallion architecture.
• Work with SQL, Python, Spark SQL and Delta Lake.
• Integrate data from APIs, databases, CRM, ERP and third party platforms.
• Support both batch and real time data processing.
• Develop semantic models and work with Star Schema and Kimball modelling.
• Implement CI/CD and automated deployment of data solutions.
• Build monitoring, data quality, lineage and observability into data pipelines.
• Work closely with Data Architects, BI teams and wider business stakeholders.

Skills

SQL

Python

ETL/ELT design

Data pipelines

CI/CD

Tools

Microsoft Fabric

Dataflow Gen2

Fabric Notebooks

Lakehouse

Spark

Spark SQL

Delta Lake

Job description

Senior Data Engineer Microsoft Fabric

Location: West Yorkshire
Working pattern: Hybrid, 2 days per week onsite
Salary:£70-80k

We are looking for a Senior Data Engineer with strong hands on Microsoft Fabric experience to help design and build a modern data platform supporting analytics, AI and operational use cases.

Microsoft Fabric is a key requirement for this role, so we are looking for someone who has used the platform in a genuine delivery environment rather than someone with only limited exposure.

Key responsibilities

• Design and build end to end ETL and ELT solutions using Microsoft Fabric
• Build scalable data pipelines using Dataflow Gen2 and Fabric Notebooks
• Develop and maintain Lakehouse solutions using Medallion architecture
• Work with SQL, Python, Spark SQL and Delta Lake
• Integrate data from APIs, databases, CRM, ERP and third party platforms
• Support both batch and real time data processing
• Develop semantic models and work with Star Schema and Kimball modelling
• Implement CI/CD and automated deployment of data solutions
• Build monitoring, data quality, lineage and observability into data pipelines
• Work closely with Data Architects, BI teams and wider business stakeholders

Essential experience

• Strong commercial experience with Microsoft Fabric
• Hands on experience with Dataflow Gen2, Fabric Notebooks and Lakehouse architecture
• Strong SQL and Python skills
• Experience with Spark and Spark SQL
• Proven experience designing scalable ETL and ELT pipelines
• Data Lake and Delta Lake experience
• Experience integrating data from multiple structured and unstructured sources
• Good understanding of CI/CD, DevOps and modern data engineering practices
• Able to work onsite in West Yorkshire 2 days per week

Experience with Semantic Models, DAX, Kimball modelling, Microsoft Fabric certifications such as DP 700, and data governance would also be beneficial.