Data Engineer

PBT Group; Johannesburg; On-site; ZAR 600 000 - 800 000; Full time

Job summary

A data solutions company in Johannesburg is seeking an experienced Data Engineer to design and optimize data solutions using Azure Data Factory and Databricks. The ideal candidate will have over 3 years of experience in data engineering, with a strong background in cloud architectures and ETL/ELT processes. This role emphasizes collaboration and continuous improvement in a fast-paced environment.

Qualifications

• 3+ years’ experience as a Data Engineer or similar role.
• Proven expertise in Azure Data Factory and Databricks.
• Strong background in cloud-based architectures and data pipelines.

Responsibilities

• Design, develop, and maintain high-performance data pipelines.
• Transform and integrate data from diverse sources.
• Optimize workflows for scalability and performance.

Skills

Azure Data Factory

Databricks

ETL/ELT pipelines

SQL

Python

Job description

Data Engineer position available in Johannesburg.

PBT Group is looking for an experienced Data Engineer with deep expertise in Azure Data Factory (ADF) and Databricks to design, develop, and optimise scalable data solutions.

This role is perfect for a proactive problem-solver who thrives in a fast-paced environment and enjoys working at the intersection of data engineering, cloud innovation, and business impact.

What You’ll Do:

• Design, develop, and maintain high-performance data pipelines using ADF and Databricks.
• Transform and integrate data from diverse sources to enable advanced analytics and reporting.
• Optimise workflows for scalability, performance, and cost-effectiveness in Azure.
• Collaborate with analysts, data scientists, and business teams to deliver clean, reliable, and governed data.
• Monitor and improve data quality, security, and compliance across platforms.
• Contribute to DevOps practices, code reviews, and continuous improvement initiatives.

What We’re Looking For:

• 3+ years’ experience as a Data Engineer (or similar).
• Proven expertise in Azure Data Factory and Databricks (Spark, Python, SQL).
• Strong background in ETL/ELT pipelines within cloud-based architectures.
• Proficiency in SQL and experience with both structured and unstructured data.
• Familiarity with Azure Synapse, Data Lake, and version control (Git).
• Solid understanding of data governance and security best practices.

Bonus Skills (Nice to Have):

• Experience with CI/CD pipelines and Infrastructure-as-Code (Terraform, Azure DevOps).
• Exposure to real-time data processing or machine learning pipelines.