Senior Data Engineer

Grant Thornton UK LLP

Hampton

On-site

GBP 70,000 - 100,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Income protection
Matched pension
Life cover
Private medical, Doctor@Hand access

Job summary

Grant Thornton UK LLP is hiring a Senior Data Engineer to design, build and run data pipelines within the Data Architecture team. You’ll lead the migration to Microsoft Fabric, establishing analytics foundations, self-service reporting and AI readiness.

You will set technical direction, coach engineers, and collaborate across Data Office, IT and business to ensure secure, governed data delivery and cost-aware operations.

Qualifications

  • Experience delivering data solutions using Microsoft Fabric (Data Factory, Lakehouse, Warehouse, Notebooks) or Databricks.
  • Strong proficiency in Python, PySpark and SQL.
  • Experience preparing data for AI use (RAG, vector databases, MCP).
  • Experience delivering a data platform or migration project in a regulated environment.

Responsibilities

  • Design, build and run data pipelines and platform components for secure, reliable data ready for use.
  • Lead workstreams migrating to Microsoft Fabric and enable analytics, self-service reporting and AI.
  • Set technical direction and coach engineers across Data Office, IT and business.
  • Ingest data from core systems (Workday, Dynamics 365, Business World, SharePoint).
  • Deliver curated, well-documented datasets for Power BI and reporting.
  • Implement security, data classification and access controls in pipelines; review work of others.
  • Redesign legacy ETL/ELT for Fabric and plan cut-over to avoid reporting breaks.
  • Set up version control, CI/CD and automated testing; monitor pipelines for performance and cost.

Skills

Microsoft Fabric
Fabric Data Factory
Fabric Lakehouse
Power BI
Python
PySpark
SQL
ETL/ELT
Data governance
CI/CD
Notebooks
AI data prep (RAG/MCP)
Data modelling
Data migration
Communication

Tools

Git
CI/CD tooling

Job description

  • As a Senior Data Engineer in the Data Architecture team, you’ll design, build and run the pipelines and platform components that make our data secure, reliable and ready to use
  • You’ll lead workstreams in our migration to Microsoft Fabric and build the foundations for analytics, self-service reporting and AI. That includes preparing governed data for retrieval-augmented generation (RAG) and Model Context Protocol (MCP)
  • You’ll set technical direction within the team, coach less experienced engineers and work with colleagues across the Data Office, IT and the business
  • Design, build and run data pipelines using Fabric Data Factory and Fabric Lakehouse, and set patterns for the team to reuse
  • Own the ingestion of data from our core systems, including Workday, Dynamics 365, Business World and SharePoint
  • Design data structures in Fabric Warehouse and Lakehouse, and deliver curated, well-documented datasets for Power BI and other reporting
  • Build security, data classification and access controls into every pipeline, and review the work of others against them
  • Redesign legacy ETL and ELT processes for Fabric, and plan cut-over so reporting carries on without a break
  • Set up version control, CI/CD and automated testing for data solutions, and monitor pipelines for performance and cost
  • Coach and mentor less experienced engineers
Benefits
  • Income protection
  • Matched pension
  • Life cover
  • Private medical, including anytime access to Doctor@Hand and Stronger Minds
  • Professional subscriptions

Experience of version control, for example Git, and of applying CI/CD to data solutions Experience in professional services or another regulated environment It would be great if you had some of the following skills, but don’t worry if you don’t tick every box, we’ll help you develop along the way Good knowledge of data governance, security and compliance, including access control and data classification Experience with data catalogue, lineage or classification tools Experience migrating from Azure Data Factory and Azure Data Lake to Fabric Working knowledge of Power BI and how it connects to Fabric datasets Joining us as a Senior Data Engineer, the minimum criteria you’ll need is strong, proven experience delivering solutions on Microsoft Fabric (Data Factory, Lakehouse, Warehouse and Notebooks) or Databricks, strong proficiency in Python, PySpark and SQL, a solid understanding of data modelling, warehousing and ETL/ELT principles, and experience of delivering a platform or data migration Clear communication with technical and non-technical colleagues, and experience of coaching or reviewing the work of less experienced engineers Experience preparing data for AI use, for example RAG, vector databases or MCP, and processing unstructured data such as PDFs and documents

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Grant Thornton UK LLP • Hampton

On-site
GBP 70,000 - 110,000
Income protection
Matched pension
Life cover
+2
Senior Fabric Architect
Senior Fabric Architect

Cognizant • Greater London

Hybrid
GBP 110,000 - 150,000
Senior Data Engineer
Senior Data Engineer

Exalto Consulting • Bradford

Hybrid
GBP 70,000 - 90,000
Data Engineer
Data Engineer

Arrow Global Group • Manchester

On-site
GBP 60,000 - 90,000
Senior Fabric Engineer
Senior Fabric Engineer

Cognizant Technology Solutions Corporation • Greater London

Hybrid
GBP 85,000 - 110,000
Data Engineer
Data Engineer

Jellycat • Greater London

On-site
GBP 70,000 - 110,000
Senior Data Engineer
Senior Data Engineer

Reed • Lewes

Hybrid
GBP 70,000 - 100,000
Senior Data Engineer (Microsoft Fabric & Azure Data Platform)
Senior Data Engineer (Microsoft Fabric & Azure Data Platform)

Acuity Analytics • Greater London

On-site
GBP 70,000 - 110,000
Data Engineer IT · London ·
Data Engineer IT · London ·

Jellycat • Greater London

On-site
GBP 65,000 - 90,000
Senior Data Engineer (Microsoft Fabric & Azure Data Platform)
Senior Data Engineer (Microsoft Fabric & Azure Data Platform)

Ascent Software • United Kingdom

On-site
GBP 70,000 - 100,000