Data Engineer — Fabric Pipelines & AI Readiness

Grant Thornton UK LLP; Milton Keynes; Hybrid; GBP 60,000 - 90,000; Full time

Job summary

Grant Thornton UK LLP is seeking a Data Engineer to build and run data pipelines within the Fabric platform. You’ll ingest data from core systems and deliver structured datasets for analytics and AI. The role emphasizes data governance, security and collaboration across teams.

You’ll migrate legacy ETL/ELT to Fabric, work with notebooks and Power BI outputs, and contribute to an architecture that enables self-service reporting and scalable analytics across the firm.

Qualifications

• Practical experience with Microsoft Fabric or Databricks.
• Strong Python, PySpark and SQL for data engineering.
• Understanding of data modelling, warehousing and ETL/ELT.
• Familiarity with Power BI and version control practices.
• Awareness of data governance, security and compliance.

Responsibilities

• Build and run data pipelines and notebooks in Fabric, using Data Factory, Lakehouse, Python, PySpark and SQL.
• Ingest data from core systems such as Workday, Dynamics 365, Business World and SharePoint.
• Create and maintain data structures in Fabric Warehouse and Lakehouse with certified datasets for Power BI.
• Prepare governed data for AI, including retrieval through RAG and MCP; convert PDFs into structured data.
• Apply data classification and access control standards to keep client and firm data separate.
• Move Azure Data Factory, Azure Data Lake and SQL Server solutions into Fabric and redesign ETL/ELT processes.
• Use CI/CD and automated testing; monitor pipelines and fix root causes.
• Document work and share learnings; stay up to date with Fabric features.

Skills

Microsoft Fabric

Databricks

Python

PySpark

SQL

Power BI

Data modelling

Data warehousing

ETL/ELT

Git

DevOps

Data governance

Security & compliance

Communication

Tools

Azure Data Factory

Azure Data Lake

Fabric

Notebooks

Git / DevOps

Job description

Grant Thornton UK LLP is seeking a Data Engineer to build and run data pipelines within the Fabric platform. You’ll ingest data from core systems and deliver structured datasets for analytics and AI. The role emphasizes data governance, security and collaboration across teams.

You’ll migrate legacy ETL/ELT to Fabric, work with notebooks and Power BI outputs, and contribute to an architecture that enables self-service reporting and scalable analytics across the firm.