Azure Data Engineer

DGH Recruitment Limited; Greater London; On-site; GBP 55,000 - 75,000; Full time

Job summary

DGH Recruitment Limited in London is seeking a hands-on Data Engineer to design and develop scalable, automated data pipelines using Azure services, from ingestion to delivery, enabling smarter insights.

You will collaborate with Data Engineers, Architects, Product Owners, and BI teams in an Agile environment, applying SQL, Python/Scala, and DevOps practices to optimise data flows and reliability.

Qualifications

• Proficiency in Azure tools (Data Factory, Databricks, Synapse, etc.).
• Strong SQL and experience with data warehousing (Kimball methodology).
• Programming skills in Python, Scala, or PySpark.
• Familiarity with Power BI, SharePoint, and data integration technologies.
• Understanding of DevOps, CI/CD, and cloud concepts (IaaS, PaaS, SaaS).
• PowerShell scripting, containerisation, Semarchy MDM, NEC Housing, PL/SQL, and Total Mobile/Repairs solutions.

Responsibilities

• Develop and maintain data pipelines using Azure services.
• Ingest, transform, and model data from diverse sources.
• Optimise data flows for performance and reliability.
• Support data quality and monitoring processes.
• Collaborate with cross-functional teams in an agile environment.

Skills

SQL

Python

Scala

PySpark

Data modeling

Tools

Azure Data Factory

Databricks

Synapse

Logic Apps

PowerShell

Job description

Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse, and Logic Apps. You'll work across the full data lifecycle — from ingestion to transformation and delivery — enabling smarter, faster insights.

Key Responsibilities:

• Develop and maintain data pipelines using Azure services.
• Ingest, transform, and model data from diverse sources.
• Optimise data flows for performance and reliability.
• Support data quality and monitoring processes.
• Collaborate with cross-functional teams in an agile environment.

Collaboration With:

• Data Engineers, Architects, Product Owners, Test Analysts, and BI Teams.

Skills & Experience:

• Proficiency in Azure tools (Data Factory, Databricks, Synapse, etc.).
• Strong SQL and experience with data warehousing (Kimball methodology).
• Programming skills in Python, Scala, or PySpark.
• Familiarity with Power BI, SharePoint, and data integration technologies.
• Understanding of DevOps, CI/CD, and cloud concepts (IaaS, PaaS, SaaS).
• PowerShell scripting, containerisation, Semarchy MDM, NEC Housing, PL/SQL, and Total Mobile/Repairs solutions.