Senior Azure Data Engineer - Remote, Spark & Pipelines

E-Merge It Recruitment; Johannesburg; Remote; ZAR 1 100 000; Full time

Job summary

A leading IT recruitment agency in South Africa seeks a Senior Data Engineer to help scale data solutions across industries including mining, telcos, and retail. The ideal candidate will have over 8 years of experience, a strong understanding of Apache Spark, and expertise in Azure cloud technologies. This full-time position offers a competitive salary of R1.1 million per annum, negotiable based on experience.

Qualifications

• 8+ years of experience in relational SQL database.
• Solid understanding of Apache Spark as a distributed data processing framework.
• Experience with data warehouse and data lake design.

Responsibilities

• Work within a team solving complex problems for various industries.
• Help develop best practices and drive improvements in data engineering.

Skills

Relational SQL database experience

Apache Spark

Data pipeline optimization

Azure cloud technologies

Python

Streaming technologies

Data engineering certification

Education

Graduate/Postgraduate degree in Computer Science or related field

Tools

Apache Spark

Azure Data Factory

Azure SQL Database

Azure Synapse Analytics

Azure Databricks

Kafka

Job description

A leading IT recruitment agency in South Africa seeks a Senior Data Engineer to help scale data solutions across industries including mining, telcos, and retail. The ideal candidate will have over 8 years of experience, a strong understanding of Apache Spark, and expertise in Azure cloud technologies. This full-time position offers a competitive salary of R1.1 million per annum, negotiable based on experience.