Senior Data Engineer - Azure Fabric & Data Platform

ATS Client; Johannesburg; On-site; ZAR 900,000 - 1,500,000; Full time

Job summary

ATS Client in Johannesburg is seeking a Senior Data Engineer to design scalable, high-performance data platforms in a banking environment. You will build data pipelines, data warehouses, and data products using Microsoft Fabric, Azure Data Factory, and Databricks.

Join a team delivering modern data architectures with a strong focus on governance, security, and DevOps, leveraging Azure Synapse Analytics, Spark, and a Kimball-based data warehouse approach.

Qualifications

• 6+ years' experience as a Data Engineer / Platform Engineer.
• Hands-on experience with Microsoft Fabric (Lakehouse, Warehouses, Pipelines, Notebooks, Semantic Models).
• Experience with Azure Data Factory, Databricks, and Azure Synapse Analytics.
• Expertise in Apache Spark for large-scale data processing.
• Strong SQL skills (T-SQL) and data analysis capabilities.

Responsibilities

• Translate business, architectural, and data requirements into scalable technical solutions.
• Design and build metadata-driven data ingestion pipelines using Azure Data Factory and Databricks.
• Develop and maintain enterprise-grade Data Warehouses (Kimball methodology).
• Build and model data products using Databricks and Microsoft Fabric.
• Implement end-to-end data engineering solutions using IDX templates into ODP (One Data Platform).
• Drive DevOps best practices, including CI/CD and automation.
• Perform unit testing, integration testing, and debugging to ensure high-quality deployments.
• Design and manage Azure infrastructure components and templates.
• Develop and maintain documentation, governance standards, and best practices.
• Collaborate with business stakeholders to understand and deliver on data requirements.
• Apply data governance and engineering standards to ensure high-quality, secure data products.
• Participate actively in data engineering and modelling communities of practice.
• Support operational processes and shared team responsibilities.

Skills

SQL

Python

Agile delivery

Data governance

Education

Bachelor's Degree in Computer Science or related field

Tools

Microsoft Fabric

Azure Data Factory

Databricks

Azure Synapse Analytics

Apache Spark

Unity Catalog

Microsoft Purview

Azure DevOps

Bicep

ARM

PowerShell

Job description

ATS Client in Johannesburg is seeking a Senior Data Engineer to design scalable, high-performance data platforms in a banking environment. You will build data pipelines, data warehouses, and data products using Microsoft Fabric, Azure Data Factory, and Databricks.

Join a team delivering modern data architectures with a strong focus on governance, security, and DevOps, leveraging Azure Synapse Analytics, Spark, and a Kimball-based data warehouse approach.