Senior Data Engineer: Fabric Pipelines & AI Platform

Grant Thornton UK LLP; Southampton; On-site; GBP 85,000 - 120,000; Full time

Job summary

Grant Thornton UK LLP is seeking a Senior Data Engineer to join the Data Architecture team. You will design, build and run pipelines on Microsoft Fabric, lead data migration workstreams to Fabric, and enable analytics, self-service reporting and AI.

You’ll mentor engineers, govern data, and partner across Data Office, IT and the business to deliver secure, scalable data solutions. The role requires strong Python, PySpark and SQL skills, plus experience with Power BI integrations and CI/CD for

Qualifications

• Strong experience delivering solutions on Microsoft Fabric or Databricks.
• Proficiency in Python, PySpark and SQL.
• Solid understanding of data modelling, warehousing and ETL/ELT.
• Experience delivering a platform or data migration.
• Nice to have: Power BI integration with Fabric datasets.
• Experience with data governance, security and classification.
• Experience migrating from Azure Data Factory/Data Lake to Fabric.
• Experience preparing data for AI use (RAG, MCP).
• Experience with data catalogue or lineage tools.
• Experience in professional services or regulated environments.
• Clear communication and mentoring of engineers.

Responsibilities

• Design, build and run data pipelines using Fabric Data Factory and Fabric Lakehouse, and set patterns for the team to reuse.
• Own the ingestion of data from core systems including Workday, Dynamics 365, Business World and SharePoint.
• Design data structures in Fabric Warehouse and Lakehouse for curated datasets for Power BI and reporting.
• Build security, data classification and access controls into pipelines and review others’ work.
• Redesign legacy ETL and ELT processes for Fabric and plan cut-over so reporting continues seamlessly.
• Set up version control, CI/CD and automated testing for data solutions and monitor pipelines for performance and cost.
• Coach and mentor less experienced engineers.

Skills

Microsoft Fabric

Python

PySpark

SQL

Power BI

Git

CI/CD

Data Governance

Databricks

Azure Data Factory

Tools

Azure Data Factory

Azure Data Lake

Git

CI/CD tooling

Job description

Grant Thornton UK LLP is seeking a Senior Data Engineer to join the Data Architecture team. You will design, build and run pipelines on Microsoft Fabric, lead data migration workstreams to Fabric, and enable analytics, self-service reporting and AI.

You’ll mentor engineers, govern data, and partner across Data Office, IT and the business to deliver secure, scalable data solutions. The role requires strong Python, PySpark and SQL skills, plus experience with Power BI integrations and CI/CD for