Azure Senior Data Engineer - 100% REMOTE - R1.1M PA

E-Merge IT Recruitment; Johannesburg; Remote; ZAR 1 100 000; Full time

Job summary

A leading IT recruitment agency in South Africa seeks a Senior Data Engineer to help scale data solutions across industries including mining, telcos, and retail. The ideal candidate will have over 8 years of experience, a strong understanding of Apache Spark, and expertise in Azure cloud technologies. This full-time position offers a competitive salary of R1.1 million per annum, negotiable based on experience.

Qualifications

• 8+ years of experience in relational SQL database.
• Solid understanding of Apache Spark as a distributed data processing framework.
• Experience with data warehouse and data lake design.

Responsibilities

• Work within a team solving complex problems for various industries.
• Help develop best practices and drive improvements in data engineering.

Skills

Relational SQL database experience

Apache Spark

Data pipeline optimization

Azure cloud technologies

Python

Streaming technologies

Data engineering certification

Education

Graduate/Postgraduate degree in Computer Science or related field

Tools

Apache Spark

Azure Data Factory

Azure SQL Database

Azure Synapse Analytics

Azure Databricks

Kafka

Job description

Introduction

We are looking for a Senior Data Engineer with a blend of technical skill and creative problem‑solving to help us scale our data solutions.

Duties & Responsibilities

You will work within a team solving complex problems to deliver real business value across a wide range of industries such as mining, telcos, retail and financial services. You will help develop best practices and drive improvements in data engineering across the organization.

Qualifications

• Graduate or Postgraduate degree in Computer Science, Information Technology, Statistics, Engineering or related technical field
• 8+ years of relational SQL database experience
• Solid understanding of Apache Spark as a distributed data processing framework
• Experience in designing, implementing and performance tuning solutions in Apache Spark
• Experience in complex data warehouse and data lake design
• Experience building, optimizing and managing data pipelines for large and complex datasets
• Experience with Azure cloud data platform technologies: Azure Storage/Data Lake, Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics
• Experience with Python is beneficial
• Experience with streaming technologies such as Spark Streaming or Kafka is beneficial
• A relevant data engineering certification is beneficial

Reference Number

Reference Number for this position is GZ60673.

Employment Details

Employment Type: Full‑Time
Experience: 8+ years
Vacancy: 1
Remote Position: Permanent Remote
Salary: Cost to Company R1.1m per annum negotiable on experience and ability