Azure Data Engineer: Lakehouse AI-Ready Analytics

PBT Group; Johannesburg; Hybrid; ZAR 700,000 - 1,100,000; Full time

Job summary

PBT Group in Johannesburg is seeking two Azure Data Engineers to implement a Medallion (Lakehouse) architecture. You will land data into the bronze layer and drive semantic modelling through to the gold layer, ensuring governance and AI-ready data products.

Work with in-house data scientists to deliver analytics-ready datasets and Power BI business views, with a strong focus on production deployment, operational excellence and Git + DevOps practices.

Qualifications

• Advanced Azure Databricks experience (Databricks Data Engineer certification preferred; Databricks AI certification advantageous).
• Strong proficiency in Python and SQL for developing data products and pipelines.
• Hands-on experience with Azure Data Factory (ADF) pipelines.
• Experience with Medallion / Lakehouse architecture (bronze, silver, gold layers).
• Semantic data modelling skills.
• Familiarity with Unity Catalog / Gateway.
• Solid understanding of Git and DevOps practices.
• Ability to produce clear technical documentation.
• Experience working in Agile environments.

Responsibilities

• Design, build and maintain data pipelines (Databricks and ADF) to ingest and land data into the bronze layer.
• Support semantic data modelling across silver and gold layers to create high-quality, governed data products.
• Collaborate with data scientists to deliver analytics-ready datasets and Power BI business views.
• Ensure data is production-ready, well-documented and aligned with AI use-case requirements.
• Apply Unity Catalog / Gateway for data governance and access control.
• Contribute to technical documentation covering design decisions, pipelines and data models.
• Work within an Agile delivery framework and follow Git + DevOps best practices.
• Support the use of Databricks Genie where relevant.

Skills

Python

SQL

Git

DevOps

Tools

Azure Databricks

Azure Data Factory

Unity Catalog / Gateway

Job description

PBT Group in Johannesburg is seeking two Azure Data Engineers to implement a Medallion (Lakehouse) architecture. You will land data into the bronze layer and drive semantic modelling through to the gold layer, ensuring governance and AI-ready data products.

Work with in-house data scientists to deliver analytics-ready datasets and Power BI business views, with a strong focus on production deployment, operational excellence and Git + DevOps practices.