Azure Data Engineer: Build Data Pipelines & Lakehouse

Blue Pearl PTY; Johannesburg; Hybrid; ZAR 600,000 - 900,000; Full time

Job summary

A leading tech company is seeking an Azure Data Engineer in Johannesburg. The role involves designing and optimizing Azure data pipelines and implementing ETL solutions using Azure Data Factory and Databricks. Candidates should possess 5+ years of experience in data engineering, strong skills in Python and SQL, and relevant Azure certifications. The position offers a hybrid working model and is aimed at South African citizens or permanent residents.

Qualifications

• 5+ years of data engineering experience, preferably with Azure.
• Proven experience in building production-scale cloud data solutions.
• Familiarity with Data Vault, Dimensional Modelling, or Medallion architecture.

Responsibilities

• Design, develop, and maintain Azure-based data pipelines.
• Implement ETL/ELT solutions using Azure Data Factory, Azure Databricks.
• Build and optimize data models including Data Lakehouse architectures.
• Ensure data quality, integrity, and governance.
• Collaborate with data scientists and analysts for clean datasets.
• Perform pipeline monitoring, troubleshooting, and optimization.
• Develop CI/CD pipelines using Azure DevOps.
• Implement security best practices including RBAC and encryption.

Skills

Azure Data Factory (ADF)

Azure Databricks (PySpark)

Azure Synapse Analytics

Python

SQL

Delta Lake

Spark

Data Lake Storage (ADLS)

Streaming technologies (Kafka, Event Hubs)

Education

Bachelor’s degree in Computer Science, Engineering, or related field

Tools

Azure DevOps

GitHub Actions

Job description

A leading tech company is seeking an Azure Data Engineer in Johannesburg. The role involves designing and optimizing Azure data pipelines and implementing ETL solutions using Azure Data Factory and Databricks. Candidates should possess 5+ years of experience in data engineering, strong skills in Python and SQL, and relevant Azure certifications. The position offers a hybrid working model and is aimed at South African citizens or permanent residents.