Azure Data Engineer

Cornwallis Elt Ltd; London; On-site; GBP 50,000 - 80,000; Full time

Job summary

A leading company in data engineering is seeking an Azure Data Engineer to modernize data platforms using Microsoft technologies. The role involves migrating data to Azure, developing workflows, and collaborating with teams to ensure data quality and performance. Ideal candidates will have a Bachelor's degree and strong expertise in Azure tools.

Qualifications

• Proven experience as an Azure Data Engineer with a focus on data migration.
• Deep technical expertise in Azure tools and CI/CD processes.
• Microsoft Azure Data Engineer Associate certification preferred.

Responsibilities

• Lead the migration of data from legacy systems into Azure.
• Design and develop cloud-based data workflows using Azure tools.
• Implement CI/CD pipelines for data pipeline deployments.

Skills

Data Migration

Cloud Integration

Problem Solving

Communication

Collaboration

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Azure Data Factory

Azure Functions

Logic Apps

Terraform

Azure DevOps

Git

Job description

Job Title: Azure Data Engineer
Location: London (2-3 days on site)
Department: Data & Engineering

About the Role
Are you passionate about modernising data platforms and working with cutting-edge Microsoft technologies? We’re looking for an experienced Azure Data Engineer to play a critical role in migrating and integrating enterprise data into scalable, cloud-first environments. You’ll work closely with cross-functional teams to build robust data pipelines and workflows across Azure and Microsoft Dynamics 365, leveraging the latest tools to ensure performance, consistency, and quality.

Key Responsibilities
Data Migration: Lead the migration of data from legacy big data systems and custom-coded ETL processes into Azure, Dataverse, and Dynamics 365 platforms.

Integration & Aggregation: Consolidate data from diverse SaaS applications and small-scale data sources into centralized Microsoft cloud environments.

Azure Development: Design and develop cloud-based data workflows using Azure Data Factory, Azure Functions, and Logic Apps.

Data Pipelines: Build and maintain scalable pipelines using Azure Data Factory and SSIS with KingswaySoft.

Infrastructure Management: Use Terraform to deploy and manage infrastructure as code (IaC) for consistent, repeatable environments.

CI/CD & Automation: Implement continuous integration and deployment pipelines using Azure DevOps, automating data pipeline deployments.

Code & Version Control: Maintain source code and collaborate effectively using Git.

Monitoring & Optimization: Monitor pipeline health, troubleshoot issues, and improve performance and scalability.

Team Collaboration: Partner with IT, marketing, customer success, and other stakeholders to define data requirements and deliver innovative solutions.

What We’re Looking For
Required:

Bachelors degree in Computer Science, Engineering, or related field.

Proven experience as an Azure Data Engineer or similar role with a focus on data migration and cloud integration.

Deep technical expertise with:

Azure Data Factory, Azure Functions, Logic Apps, Dataverse, and Microsoft Fabric

Terraform for infrastructure provisioning

CI/CD tools such as Azure DevOps

Git for version control

Preferred:

Hands-on experience with Dynamics 365 (D365), KingswaySoft, and the Microsoft Power Platform

Microsoft Azure Data Engineer Associate certification

Soft Skills:

Strong problem-solving capabilities

Clear, effective communication

Ability to collaborate across teams and disciplines