Senior Data Engineer (MS SQL, Ms Fabric) - Johannesburg - up to R1.2mil per annum

ATS Client; Johannesburg; On-site; ZAR 720,000 - 1,200,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

ATS Client in Cape Town seeks a Senior Data Engineer to design, build, and optimize scalable data platforms and pipelines powering BI, analytics, ML, and AI solutions.

You will mentor junior engineers, lead data best practices, and collaborate with cross‑functional teams to deliver production‑ready data products in a fast‑paced environment.

Qualifications

• Bachelor's or Master's in CS/IT/Engineering.
• 5+ years as Data Engineer or similar.
• 5+ years Python development.
• 5+ years MS SQL Server experience; PostgreSQL a plus.
• Experience with enterprise data warehouses and dimensional modelling.
• Cloud data platforms (Azure, AWS) and on‑premise SQL Server/SSIS.
• Hands-on Spark experience.
• Experience with CI/CD/CT pipelines.

Responsibilities

• Design, build, and optimize scalable data pipelines.
• Develop data warehouses and Data Marts in the EDW.
• Create API integrations for data flows.
• Collaborate with cross-functional teams to deliver data solutions.
• Implement data quality, governance, and monitoring.
• Productionise ML/AI solutions with Data Scientists.
• Maintain CI/CD/CT pipelines for deployment.
• Troubleshoot production data issues and resolve problems.

Skills

Python

ETL/ELT

SQL Server

Data Warehousing

Cloud (Azure/AWS)

Apache Spark

CI/CD

Data Modeling

Education

Bachelor's or Master's in CS/IT/Engineering

Tools

SSIS

PostgreSQL

Azure

AWS

Microsoft Fabric

SQL Server

Job description

We are looking for an experienced Senior Data Engineer to join our growing Data Engineering team. In this role, you will design, build, and optimize scalable data platforms and pipelines that power business intelligence, analytics, machine learning, and AI solutions. As a technical leader, you will architect robust data solutions, drive best practices, mentor junior engineers, and collaborate with cross-functional teams to deliver high-quality, production-ready data products in a fast-paced environment.

Responsibilities

• Design, develop, and maintain scalable data pipelines and enterprise data platforms.
• Build and manage end-to-end data pipelines, including data ingestion, transformation, and Data Marts within the Enterprise Data Warehouse.
• Develop and maintain API integrations to support increasing data volumes and complexity.
• Collaborate with business, analytics, and engineering teams to deliver reliable, accessible, and high-quality data solutions.
• Design and optimize data models, ETL/ELT processes, and dimensional data warehouse architectures.
• Implement data quality, monitoring, and governance frameworks to ensure trusted production data.
• Partner with Data Scientists to productionise machine learning and AI solutions.
• Build and maintain CI/CD/CT pipelines to automate deployment and delivery of data solutions.
• Troubleshoot production data issues and implement sustainable solutions.

Qualifications & Experience

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related technical discipline.
• 5+ years of experience as a Data Engineer or in a similar role.
• 5+ years of Python development experience.
• 5+ years of Microsoft SQL Server experience (PostgreSQL is advantageous).
• Strong experience designing and implementing enterprise data warehouses, dimensional modelling, and schema design.
• Experience designing, building, and maintaining data processing systems across cloud platforms (Azure, AWS, Microsoft Fabric) and on-premises environments (Microsoft SQL Server, SSIS).
• Strong experience developing ETL/ELT processes and scalable data pipelines.
• Hands‑on experience with Apache Spark.
• Experience implementing CI/CD/CT pipelines for automated deployment and delivery.

The reference number for this position is NG61441 which is a Permanent, Hybrid role in Cape Town, offering a salary of up to R1.2mil per annum salary negotiable based on experience.