Data Engineer: Fabric & Azure Data Pipelines

Core-Asset Consulting Ltd; Newcastle upon Tyne; On-site; GBP 60,000 - 90,000; Full time

Benefits offered by this job

A highly competitive salary

Wider Benefits package

Job summary

Core-Asset Consulting Ltd is seeking a data engineer to design, build and optimize data pipelines using Microsoft Fabric. You will collaborate with business stakeholders to translate requirements into scalable data solutions and ensure reliability and performance.

The role emphasizes strong T-SQL, Spark/PySpark, and Azure expertise, with opportunities to migrate legacy reporting and work in a dynamic, improvement-focused environment.

Qualifications

• Proficient in T-SQL and writing complex queries.
• Strong Spark and PySpark experience for scalable processing.
• Solid understanding of OLTP/OLAP and data modelling.
• Experience with Azure services including Fabric, Data Factory, Data Lake and Data Warehouse.
• Knowledge of ETL/ELT best practices.
• Analytical mindset focused on data accuracy and reliability.
• Excellent collaboration and communication with stakeholders.
• Adaptable to dynamic environments and continuous improvement.

Responsibilities

• Translate complex transactional data into optimized analytical models (facts and dimensions).
• Design, build and enhance data pipelines within Microsoft Fabric for performance and quality.
• Engineer integrations from various data sources using ETL/ELT methods.
• Monitor and optimize SQL-based workflows for daily data processing.
• Lead migration of legacy datasets to modern platforms with minimal disruption.
• Collaborate with analytics teams to develop data models and engineered datasets.
• Partner with data science to create summaries and aggregates for analytics and modelling, and respond to ad hoc data requests.

Skills

T-SQL

Spark/PySpark

OLTP/OLAP data modelling

Azure Fabric/Data Factory/Data Lake/W

ETL/ELT best practices

Data accuracy / reliability

Collaboration & communication

Continuous improvement

Tools

Azure Data Factory

SQL Server

Job description

Core-Asset Consulting Ltd is seeking a data engineer to design, build and optimize data pipelines using Microsoft Fabric. You will collaborate with business stakeholders to translate requirements into scalable data solutions and ensure reliability and performance.

The role emphasizes strong T-SQL, Spark/PySpark, and Azure expertise, with opportunities to migrate legacy reporting and work in a dynamic, improvement-focused environment.