Senior Data Engineer (Azure) - Fully Remote - Up To R1.1M Per Annum

E-Merge; Johannesburg; Remote; ZAR 935 000 - 1 100 000; Full time

Job summary

A forward-thinking technology solutions company is seeking an experienced Senior Data Engineer (Azure) to join their data team. This remote position focuses on delivering innovative data solutions using Azure technologies. The ideal candidate will have over 8 years of experience in relational databases and Apache Spark, contributing to data-driven business solutions.

Qualifications

• 8+ years of relational SQL database experience.
• Solid understanding of Apache Spark for data processing.
• Experience in designing and implementing Apache Spark solutions.

Responsibilities

• Develop best practices in data engineering.
• Solve complex problems to deliver business value.
• Drive improvements across the data engineering team.

Skills

Relational SQL database

Apache Spark

Data pipeline development

Azure cloud technologies

Python

Streaming technologies

Education

Relevant data engineering certification

Tools

Azure Storage

Data Lake

Azure SQL Database

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Job description

Overview

A forward-thinking technology solutions company dedicated to delivering cutting-edge digital transformation services to clients worldwide is seeking an experienced Senior Data Engineer (Azure) to join their high-performing data team.

You will work within a team solving complex problems to deliver real business value across a wide range of industries, you will also be required to develop best practices and drive improvements in data engineering across the business.

To be part of this technology and analytics driven consulting company empowering clients by solving real-world business challenges that deliver tangible value. APPLY NOW!!!!

Requirements

• 8+ years of relational SQL database
• Solid understanding of Apache Spark as a distributed data processing framework
• Experience in designing, implementing and performance tuning solutions in Apache Spark
• Experience in complex data warehouse and data lake design
• Experience in building, optimising and manging data pipelines for large and complex datasets
• Experience using Azure cloud data platform technologies including: Azure Storage / Data Lake, Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics to implement data pipelines and analytical solutions
• Experience in Python would be beneficial
• Experience with streaming technologies such as Spark streaming or Kafka would be beneficial
• A relevant data engineering certification would be beneficial

Reference Number for this position is MAT60673 which is a REMOTE permanent position offering a salary of up to R1.1m per annum