Lead Data Engineer

SF Recruitment (Tech) Careers; Sutton Coldfield; On-site; GBP 60,000 - 80,000; Full time

Job summary

A leading recruitment agency is seeking a Data Architect to design and implement an Azure-based data platform. This strategic role involves building scalable data architecture and overseeing the integration of various core systems. The ideal candidate should have experience in ETL/ELT processes and a strong understanding of data governance. This position is located in Sutton Coldfield, United Kingdom.

Qualifications

• Experience in designing and implementing Azure-based data platforms.
• Strong familiarity with ETL/ELT pipelines and Azure Data Factory.
• Understanding of data governance and quality standards.

Responsibilities

• Design and implement an enterprise data lake on Azure Data Lake Gen2.
• Build and maintain scalable ETL/ELT pipelines in Azure Data Factory.
• Develop the overall data model, data dictionaries, and lineage documentation.

Job description

About the Role

We're working with a market-leading organisation that's undergoing a major transformation, moving from manual, Excel-based reporting to a fully automated, intelligence-driven data ecosystem.

As Data Architect, you'll be responsible for designing and implementing the Azure-based data platform that becomes the single source of truth across the business. This is a hands‑on, strategic role where you'll build scalable, governed data architecture and shape how data is used across Finance, Operations, and Commercial functions.

What You’ll Be Doing

Data Architecture & Platform Design

Design and implement an enterprise data lake on Azure Data Lake Gen2, using Bronze / Silver / Gold architecture.

Build and maintain scalable ETL / ELT pipelines in Azure Data Factory to integrate data from core systems (AS400, Tagetik, CRM, Esker, Slimstock).

Develop the overall data model, data dictionaries, and lineage documentation.

Deliver a stable “batch-first” integration strategy with AS400 during its .NET migration, with a roadmap toward API integration.

Data Governance & Quality