Senior Data Engineer — Fabric & AI Platform

Grant Thornton UK LLP; Leeds; On-site; GBP 65,000 - 90,000; Full time

Benefits offered by this job

Flexible working

Job summary

Grant Thornton UK LLP is seeking a Senior Data Engineer within the Data Architecture team to design, build and run data pipelines that are secure, reliable and ready for analytics and AI. You will lead workstreams migrating to Microsoft Fabric, shaping the foundations for self-service reporting and data governance.

Day-to-day you’ll own ingestion from core systems, design Fabric-based structures, and ensure well-documented datasets for Power BI.

Qualifications

• Strong, proven experience delivering data solutions on Microsoft Fabric (Data Factory, Lakehouse, Warehouse) or Databricks.
• Proficiency in Python, PySpark and SQL, with solid data modelling, warehousing and ETL/ELT knowledge.
• Experience delivering a platform or data migration project in a regulated or professional services environment.

Responsibilities

• Design, build and run data pipelines using Fabric Data Factory and Fabric Lakehouse, establishing reusable patterns.
• Own ingestion of data from core systems (Workday, Dynamics 365, Business World, SharePoint).
• Design data structures in Fabric Warehouse and Lakehouse; deliver curated datasets for Power BI and reporting.
• Incorporate security, data classification and access controls in pipelines and review colleagues' work.
• Redesign legacy ETL/ELT processes for Fabric and plan cut-overs to maintain reporting continuity.
• Set up version control, CI/CD and automated testing for data solutions; monitor pipelines for performance and cost.
• Coach and mentor less experienced engineers.

Skills

Python

PySpark

SQL

Power BI

Git

CI/CD

Data governance

Data migration

AI data prep

Communication

Tools

Fabric Data Factory

Fabric Lakehouse

Fabric Warehouse

Databricks

Notebooks

Azure Data Factory

Azure Data Lake

Power BI connectors

Job description

Grant Thornton UK LLP is seeking a Senior Data Engineer within the Data Architecture team to design, build and run data pipelines that are secure, reliable and ready for analytics and AI. You will lead workstreams migrating to Microsoft Fabric, shaping the foundations for self-service reporting and data governance.

Day-to-day you’ll own ingestion from core systems, design Fabric-based structures, and ensure well-documented datasets for Power BI.