Azure Data Engineer

Accion Labs Europe; Greater London, Tipton; On-site; GBP 70,000 - 95,000; Full time

Job summary

Accion Labs Europe in London is seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data solutions supporting BI, analytics, and data-driven decision-making.

The role focuses on data modeling, data pipeline development, Azure data services, data warehousing, SQL, Python, Power BI, and AI. You will collaborate with data scientists, analysts, and engineers to translate requirements into reliable data solutions.

Qualifications

• Hands-on with Azure Data Services including Synapse SQL Pool / Data Warehouse.
• Strong experience with Azure DevOps and DevOps project flows.
• Advanced SQL skills and Power BI proficiency.
• Experience with MySQL or MariaDB relational databases.
• Solid data modeling, ETL, data warehousing and data pipelines knowledge.
• Strong stakeholder management and communication in client-facing settings.
• Understanding of data security, performance optimization, monitoring and troubleshooting.

Responsibilities

• Design and develop scalable data models to support BI and analytics.
• Build and optimize data storage, processing, and retrieval using Azure services.
• Design, develop and maintain ETL processes to load data into Azure data services.
• Create robust data pipelines using Azure Data Factory for smooth data flow.
• Develop data warehouse/data lakehouse solutions on Azure for performance and cost efficiency.
• Utilize Azure Synapse Analytics for large-scale data analytics.
• Develop Python scripts to automate data processing tasks and workflows.
• Create interactive Power BI dashboards and reports for data-driven decisions.
• Provide end-user training for data visualization tools.
• Write and optimize complex SQL queries for data extraction and transformation.
• Manage and administer Azure SQL databases with a focus on security and performance.

Skills

Azure Data Services

Azure Synapse

Azure Data Factory

Azure Data Lake

Azure SQL

Advanced SQL

Python

Power BI

Data Modeling

ETL Processes

Data Warehousing

Data Pipelines

Data Security

Stakeholder Management

Communication Skills

Tools

Azure DevOps

MySQL

MariaDB

Power BI

Job description

We are looking for an experienced Azure Data Engineer to design, develop, and maintain scalable data solutions supporting business intelligence, analytics, and data-driven decision-making.

The role will focus on data modeling, data pipeline development, Azure data services, data warehousing, SQL, Python, Power BI, and AI. You will work closely with business stakeholders, data analysts, data scientists, and engineering teams to translate business requirements into reliable and efficient data solutions.

The ideal candidate has strong hands-on experience with Azure Synapse, Azure Data Factory, Azure Data Lake, Azure SQL, advanced SQL, Python, and Power BI, together with strong stakeholder management and communication skills.

Work Arrangement: On-site – London, UK

What You’ll Do

• Design and develop scalable, efficient, and reliable data models to support business intelligence and analytics needs.
• Develop and implement architectural strategies for data storage, processing, and retrieval using Azure cloud services.
• Design, develop, and maintain ETL processes to ingest, transform, and load data from various sources into Azure data services.
• Build robust data pipelines using Azure Data Factory (ADF) to ensure smooth data flow and integration between different systems.
• Design, implement, and manage data warehouse / data lakehouse solutions on Azure, ensuring optimal performance, scalability, and cost efficiency.
• Utilize Azure Synapse Analytics to develop, optimize, and manage data warehousing solutions for large-scale data analytics.
• Develop and maintain Python scripts to automate data processing tasks and workflows.
• Design and create interactive Power BI dashboards and reports to enable data-driven decision-making.
• Provide support and training to end users for the effective utilization of data visualization tools.
• Write and optimize complex SQL queries for data extraction, transformation, and loading operations.
• Manage and administer Azure SQL databases, ensuring data integrity, security, and performance.
• Monitor data systems for performance, security, and reliability issues and implement enhancements as required.
• Identify and resolve data-related issues promptly to ensure the smooth operation of data processes.
• Collaborate with business stakeholders to understand data requirements and translate them into technical specifications.
• Work closely with data scientists, analysts, and other engineering teams to deliver comprehensive data solutions.
• Engage directly with stakeholders and clients, clearly communicating technical concepts and requirements.
• Maintain comprehensive documentation for data models, pipelines, and processes to ensure knowledge sharing and continuity.
• Ensure all data solutions comply with organizational policies, industry standards, and regulatory requirements.

Mandatory Skills

• Strong hands-on experience with Azure Data Services, including:
• Azure Synapse Dedicated SQL Pool / Data Warehouse
• Strong experience with Azure DevOps, including understanding of DevOps project flows.
• Advanced SQL skills.
• Hands-on experience with Power BI.
• Experience with relational databases such as:
• MySQL
• MariaDB
• Strong understanding of data modeling, ETL processes, data warehousing, and data pipelines.
• Strong stakeholder management and communication skills, with the ability to work effectively in a client-facing environment.
• Good understanding of data security, performance optimization, monitoring, and troubleshooting.

Nice to Have

• Experience with CI/CD pipelines.
• Experience implementing CI/CD for data engineering solutions using Azure DevOps.
• Experience with automated testing and deployment of data engineering solutions.
• Exposure to AI-related technologies and solutions.