Senior Data Engineer

GTC Recruitment; City Of London; On-site; GBP 60,000 - 80,000; Full time

Job summary

A recruitment agency is seeking a Senior Data Engineer to join their team in the UK. The ideal candidate will implement data flows, improve scalability, and optimize data processes. Required skills include extensive experience in ETL/ELT, Azure Data Factory, and SQL Server, as well as expertise in Microsoft Fabric and Power BI. This role involves delivering business intelligence solutions and ensuring high data quality across systems.

Qualifications

• Strong experience in ETL/ELT development, particularly using Azure Data Factory.
• Extensive experience with SQL Server and data warehousing.
• Strong hands-on experience with Microsoft Fabric.

Responsibilities

• Implement data flows connecting operational systems, analytics platforms, and BI solutions.
• Document source-to-target mappings and define data architecture.
• Re-engineer manual data processes to improve scalability, reusability, and performance.

Skills

ETL/ELT development

Azure Data Factory

SQL Server

Microsoft Fabric

Data modelling

Data warehousing

Power BI

Data lakes

Tools

Azure SQL

Power BI

Synapse Analytics

Job description

Our client is looking for a Senior Data Engineer to join a multi-disciplinary team responsible for delivering a range of data and analytics outcomes in support of wider Technology Services teams.

You will play a key role in the design, development, and maintenance of scalable data products and business intelligence solutions. This includes building robust data platforms, ensuring high standards of data quality, and providing actionable insights to support informed decision-making across the organisation.

Key Deliverables & Outcomes

• Development of enterprise-scale data products, including data warehousing, data models, reporting, and business applications.
• Provision of specialist expertise across the Microsoft BI Stack, including Azure SQL, Microsoft Fabric, Synapse Analytics, and Power BI.
• Delivery and ongoing maintenance of business intelligence solutions using the Power Platform.
• Analysis of data across descriptive, diagnostic, and predictive analytics.
• Delivery of insights to senior decision-makers and key stakeholders.
• Provision of a managed data service supporting both project delivery and BAU activities.
• Governance and assurance of data quality across systems, ensuring accuracy, reliability, and compliance.

Key Responsibilities

As a Senior Data Engineer, you will:

• Implement data flows connecting operational systems, analytics platforms, and BI solutions.
• Document source-to-target mappings and define data architecture.
• Re-engineer manual data processes to improve scalability, reusability, and performance.
• Support the development of batch and streaming data processing systems.
• Write and optimise ETL/ELT scripts and pipelines to ensure efficient data processing.
• Develop reusable and governed Power BI reports and dashboards.
• Build secure, accessible, and well-governed data solutions for analytics and reporting.
• Identify opportunities to reuse existing data assets and optimise workflows.
• Lead the implementation of data streaming solutions and associated best practices.
• Optimise code to ensure high-performance and reliable data processing.
• Lead database management activities, ensuring security, scalability, and reliability.

Technical Skills & Experience (Essential)

• Strong experience in ETL/ELT development, particularly using Azure Data Factory.
• Extensive experience with SQL Server and data warehousing.
• Strong hands‑on experience with Microsoft Fabric.
• Experience working with large and complex datasets.
• Proven expertise in data modelling and data design.
• Basic database administration (DBA) skills.
• Development of reports and dashboards using Power BI.
• Experience with data lakes and cloud‑based data warehousing.

Desirable Skills & Experience

• Experience using ServiceNow.
• Code version control using GitHub or similar tools.
• Experience with CI/CD pipelines.
• Microsoft certification in Fabric and/or Power BI.