Lead Azure Data Engineer

Robert Walters UK; Manchester; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading recruitment agency is seeking an experienced Lead Azure Data Engineer to work on a critical project in Manchester. This contract role offers a competitive rate of up to £450/day and involves designing and maintaining data pipelines on the Azure platform. The ideal candidate will have proven experience in delivering Azure solutions, strong skills in SQL and Python, and a passion for optimizing data processes. This role requires on-site presence for 2-3 days per week with potential for extension.

Qualifications

• Proven commercial experience as a Data Engineer delivering enterprise-scale solutions in Azure.
• Understanding of CI/CD in a data environment, ideally with tools like Azure DevOps.
• Experience working within consultancy or client-facing projects is highly desirable.

Responsibilities

• Design, build and maintain scalable and secure data pipelines on the Azure platform.
• Develop and deploy data ingestion processes using Azure Data Factory, Databricks (PySpark), and Azure Synapse Analytics.
• Optimise ETL/ELT processes to improve performance, reliability and efficiency.
• Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs.
• Collaborate with Data Architects, Analysts, and stakeholders to define data models and ensure best practices in data engineering.
• Ensure compliance with data governance and security policies (incl. GDPR and ISO standards).

Skills

Data Engineering

SQL

Python

Azure DevOps

Tools

Azure Data Factory

Databricks

Azure Synapse Analytics

Job description

Overview

Lead Azure Data Engineer. Rate up to £450/day. Outside IR35. Location: 2 days a week onsite in Manchester. Duration: 6 Months + Likely Extension.

We are working with a well-established retailer based in Manchester seeking an experienced Lead Azure Data Engineer to join the project on an initial 6-month contract, with likelihood for extension.

Responsibilities

• Design, build and maintain scalable and secure data pipelines on the Azure platform.
• Develop and deploy data ingestion processes using Azure Data Factory, Databricks (PySpark), and Azure Synapse Analytics.
• Optimise ETL/ELT processes to improve performance, reliability and efficiency.
• Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs.
• Collaborate with Data Architects, Analysts, and stakeholders to define data models and ensure best practices in data engineering.
• Ensure compliance with data governance and security policies (incl. GDPR and ISO standards).

Required Skills & Experience

• Proven commercial experience as a Data Engineer delivering enterprise-scale solutions in Azure
• SQL & Python
• Understanding of CI/CD in a data environment, ideally with tools like Azure DevOps
• Experience working within consultancy or client-facing projects is highly desirable

Eligibility & Requirements

Applicants must hold right to work in the UK, live a commutable distance to Manchester, and have their own Ltd company.

Application

If interested in the Lead Azure Data Engineer role, please apply with your latest Word CV for immediate review.

About the Agency

Robert Walters Operations Limited is an employment business and employment agency and welcomes applications from all candidates.

Job Details

• Contract Type: Temporary Interim Management
• Salary: £400 - £475 per day + Outside IR35 - 2-3 days onsite per week
• Workplace Type: On-site
• Experience Level: Mid Management
• Location: Manchester
• Industry: IT