Data Engineer: Fabric & AI-Ready Data Pipelines

Grant Thornton UK LLP; Chilworth Old Village; On-site; GBP 70,000 - 95,000; Full time

Job summary

Grant Thornton UK LLP is seeking a Data Engineer to join the Data Architecture team. You’ll build and run data pipelines in Fabric, ingest data from core systems, and deliver certified datasets for Power BI analysts to reuse.

You’ll work on migration to Microsoft Fabric, implement governance, security and CI/CD, and collaborate with colleagues to ensure reliable reporting. Flexible working options may be available.

Qualifications

• Experience with Microsoft Fabric and data pipelines.
• Proficient in Python, PySpark and SQL for data engineering.
• Understanding of data modelling, warehousing and ETL/ELT principles.

Responsibilities

• Build and run data pipelines and notebooks in Fabric using Data Factory, Lakehouse, Python, PySpark and SQL.
• Ingest data from core systems like Workday, Dynamics 365, Business World and SharePoint.
• Build and maintain data structures in Fabric Warehouse and Lakehouse and deliver datasets for Power BI.
• Prepare governed data for AI, including retrieval through RAG and MCP, and convert PDFs to structured data.
• Apply data classification and access control standards to keep client and firm data separate.
• Move existing Azure Data Factory, Azure Data Lake and SQL Server solutions into Fabric and redesign ETL/ELT.
• Use version control, CI/CD, automated testing and monitoring to keep pipelines reliable.
• Document work and stay current with Fabric features.

Skills

Python

PySpark

SQL

Data modeling

Data governance

Security & compliance

Communication

Tools

Microsoft Fabric

Databricks

Azure Data Factory

Azure Data Lake

SQL Server

Power BI

Git / DevOps

Job description

Grant Thornton UK LLP is seeking a Data Engineer to join the Data Architecture team. You’ll build and run data pipelines in Fabric, ingest data from core systems, and deliver certified datasets for Power BI analysts to reuse.

You’ll work on migration to Microsoft Fabric, implement governance, security and CI/CD, and collaborate with colleagues to ensure reliable reporting. Flexible working options may be available.