Azure Data Engineer: Lakehouse & AI-Ready Data Pipelines

PBT Group; Johannesburg; Hybrid; ZAR 700,000 - 950,000; Full time

Benefits offered by this job

Hybrid work arrangement

Johannesburg base

Job summary

PBT Group is seeking two Data Engineers to implement a Medallion (Lakehouse) architecture, landing data into the bronze layer and enabling semantic modelling through to the gold layer. You will work with an in-house data scientist to develop production-ready data products and Power BI views.

The role emphasizes production deployment, documentation, and governance using Databricks, ADF, and Unity Catalog within an Agile environment. Hybrid work based in Johannesburg.

Qualifications

• Advanced Azure Databricks experience; Databricks certifications preferred.
• Strong Python and SQL for data products and pipelines.
• Hands-on experience with Azure Data Factory pipelines.
• Experience with Medallion / Lakehouse architecture (bronze, silver, gold).
• Semantic data modelling skills.
• Familiarity with Unity Catalog / Gateway.
• Solid Git and DevOps practices understanding.
• Ability to produce clear technical documentation.
• Experience in Agile environments.

Responsibilities

• Design, build and maintain data pipelines (Databricks and ADF) to land data into bronze layer.
• Support semantic modelling across silver and gold layers for governed data products.
• Collaborate with data scientists to deliver analytics-ready datasets and Power BI views.
• Ensure data is production-ready and well-documented per AI use-case requirements.
• Apply Unity Catalog / Gateway for governance and access control.

Skills

Azure Databricks

Python

SQL

ADF

Medallion / Lakehouse

Semantic data modelling

Unity Catalog / Gateway

Git / DevOps

Documentation

Agile

Job description

PBT Group is seeking two Data Engineers to implement a Medallion (Lakehouse) architecture, landing data into the bronze layer and enabling semantic modelling through to the gold layer. You will work with an in-house data scientist to develop production-ready data products and Power BI views.

The role emphasizes production deployment, documentation, and governance using Databricks, ADF, and Unity Catalog within an Agile environment. Hybrid work based in Johannesburg.