Data Engineer: Build AI-Ready Data Pipelines on Fabric

Grant Thornton UK LLP; Southampton; On-site; GBP 55,000 - 85,000; Full time

Job summary

Grant Thornton UK LLP is seeking a Data Engineer to join the Data Architecture team. You will build and run data pipelines and notebooks in Fabric, migrate pipelines, and support analytics and AI readiness. The role focuses on secure, reliable data delivery and reusable datasets for analysts.

The ideal candidate will have strong skills in Python, PySpark, SQL, and Power BI, with hands-on experience in Fabric or Databricks, and a good grounding in data governance and CI/CD practices.

Qualifications

• Experience with Microsoft Fabric or Databricks is essential.
• Proficiency in Python, PySpark and SQL for data engineering tasks.
• Understanding of data modelling, warehousing and ETL/ELT principles.
• Working knowledge of Power BI and version control (Git/DevOps).
• Awareness of data governance, security and compliance best practices.
• Ability to manage own workload and communicate clearly with both technical and non-technical colleagues.

Responsibilities

• Build and run data pipelines and notebooks in Fabric, using Data Factory, Lakehouse, Python, PySpark and SQL.
• Ingest data from core systems (Workday, Dynamics 365, Business World, SharePoint).
• Build and maintain data structures in Fabric Warehouse and Lakehouse; deliver certified datasets for Power BI.
• Prepare governed data for AI, including retrieval through RAG and MCP; convert documents into structured form.
• Move Azure Data Factory, Azure Data Lake and SQL Server solutions into Fabric; redesign legacy ETL/ELT processes.
• Apply data classification, access control and co-mingling standards to keep client and firm data separate.
• Use version control, CI/CD, automated testing and monitoring to keep pipelines reliable and traceable.
• Document work and share learnings; keep up to date with Fabric features.

Skills

Microsoft Fabric

Databricks

Python

PySpark

SQL

Data modelling

ETL/ELT

Power BI

Git/DevOps

Data governance

Tools

Azure Data Factory

Azure Data Lake

SQL Server

Fabric Notebooks

Job description

Grant Thornton UK LLP is seeking a Data Engineer to join the Data Architecture team. You will build and run data pipelines and notebooks in Fabric, migrate pipelines, and support analytics and AI readiness. The role focuses on secure, reliable data delivery and reusable datasets for analysts.

The ideal candidate will have strong skills in Python, PySpark, SQL, and Power BI, with hands-on experience in Fabric or Databricks, and a good grounding in data governance and CI/CD practices.