Azure Data Engineer

Dina Gates Recruitment (Pty) Ltd; Kempton Park; On-site; ZAR 400,000 - 500,000; Full time

Job summary

A dynamic recruitment agency in Gauteng is seeking an experienced Azure Data Engineer to join their data team. The successful candidate will design and maintain data pipelines on Azure, leveraging skills in SQL, Databricks, and data warehousing. Ideal for professionals with a strong background in data engineering and the Microsoft Azure ecosystem, this role offers an opportunity to significantly impact business insights and analytics initiatives.

Qualifications

• Minimum 2 years of hands-on experience as a Data Engineer focusing on Microsoft Azure.
• Strong problem-solving skills and attention to detail.
• Excellent communication skills and ability to collaborate with cross-functional teams.

Responsibilities

• Design, develop, and maintain robust data pipelines on Azure.
• Collaborate with data scientists and business stakeholders.
• Build and optimize data warehousing solutions using Azure Synapse Analytics.

Skills

SQL querying

Azure Data Factory

Database design

Azure Databricks

ETL methodologies

Problem-solving

Communication

Tools

Azure Synapse Analytics

Power BI

Apache Spark

Job description

Overview

We are seeking a skilled Azure Data Engineer with a minimum of 2 years of experience to join our dynamic data team. The ideal candidate will have a strong background in SQL, Microsoft Azure, data warehousing, data modelling and ETL processes, with hands-on experience in Databricks, OLAP, and Azure Synapse Analytics. You will play a key role in architecting, designing, and implementing scalable data solutions that drive business insights and support analytics initiatives.

Responsibilities

• Design, develop, and maintain robust data pipelines and ETL processes on the Azure platform.
• Collaborate with data scientists, analysts, and business stakeholders to deliver end-to-end data solutions.
• Build and optimize data warehousing solutions using Azure Synapse Analytics and other Azure data services.
• Develop and maintain scalable data models and database structures with solid principles in database design.
• Implement and manage Databricks notebooks and clusters for efficient big data processing and analytics.
• Work with OLAP technologies to enhance data aggregation, reporting, and analysis.
• Ensure data quality, integrity, and security across different data sources.
• Monitor and troubleshoot data pipelines and optimize performance.
• Document data flow, architecture, and processes for knowledge sharing and compliance.

Required Qualifications and Skills

• Minimum 2 years of hands-on experience as a Data Engineer with a focus on the Microsoft Azure ecosystem.
• Proficient in SQL querying, database design, and optimization.
• Strong experience with Azure Data Platform services : Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Blob Storage, and Azure SQL Database.
• Experience designing and building data warehouses or data marts.
• Knowledge of ETL / ELT tools and methodologies.
• Familiarity with OLAP cubes and multidimensional data models.
• Experience with big data technologies and frameworks like Apache Spark on Databricks.
• Ability to work with structured and unstructured data.
• Strong problem-solving skills and attention to detail.
• Excellent communication skills and ability to collaborate with cross-functional teams.

Desirable Skills

• Experience with Power BI or other BI tools.
• Familiarity with data governance and security best practices.
• Knowledge of Python, Scala, or other scripting languages.
• Cloud certifications like Microsoft Certified : Azure Data Engineer Associate.