SC Cleared Senior Data Engineer

IF Recruitment Ltd; Greater London; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A recruitment agency is seeking a skilled data professional in the Greater London area. The role involves implementing data flows, documenting architectures, and optimising ETL processes. Candidates must have extensive experience with SQL Server, data warehousing, and cloud solutions. This hybrid position requires 2 days onsite and travel to client sites in the UK. Successful applicants will need to hold or be willing to undergo SC Clearance. The contract has a definitive end date of April 23, 2026.

Qualifications

• Experience in data analytics and Business Intelligence.
• Strong knowledge of data architecture and ETL processes.
• Familiarity with data streaming and batch processing systems.

Responsibilities

• Implement data flows to connect operational systems and analytics platforms.
• Document source-to-target mappings and define data architecture.
• Lead the implementation of data streaming solutions.

Skills

ETL/ELT development using Azure Data Factory

Extensive experience with SQL Server

Strong understanding of Microsoft Fabric

Experience with large and complex datasets

Data Modelling and Design expertise

Basic DBA skills

Report development in Power BI

Experience with data lake and cloud data warehousing

Job description

The Project:

• Implement data flows to connect operational systems, analytics platforms, and Business Intelligence (BI) systems.
• Document source-to-target mappings and define data architecture.
• Re-engineer manual data flows to enable scalability and reusability.
• Support the build of data streaming and batch processing systems.
• Write ETL (extract, transform, load) scripts and code to ensure optimal ETL performance.
• Develop reusable Business Intelligence reports and dashboards.
• Build accessible and governed data solutions for analysis.
• Recognise opportunities to reuse existing data flows and optimise processes.
• Lead the implementation of data streaming solutions and best practices.
• Optimise code and ensure high-performance data processing.
• Lead work on database management, ensuring security, scalability, and reliability.
• Development of data products such as data warehousing, data models, reporting, and business applications at scale to support improved business outcomes.

Skills Required:

• ETL/ELT development using tools such as Azure Data Factory.
• Extensive experience with SQL Server and Data Warehousing.
• Strong understanding and experience working with Microsoft Fabric.
• Experience working with large and complex datasets.
• Data Modelling and Design expertise.
• Understanding in Power Platform to deliver new Business Intelligence solutions and maintain existing solutions
• Basic DBA skills.
• Report development in Power BI.
• Experience with data lake and cloud data warehousing.

Please note:

• This is hybrid role with 2 days onsite + travel to other client sites in the UK as required
• Candidates must hold or be willing to undergo SC Clearance
• This role has a hard finish - 23rd April 2026.