Senior Data Engineer

Tenth Revolution Group; Johannesburg; Hybrid; ZAR 700,000 - 1,100,000; Full time

Job summary

The Senior Data Engineer role at Tenth Revolution Group in Johannesburg offers a hybrid work arrangement on a permanent basis. You will design, build and optimise scalable data pipelines and platforms to enable advanced analytics, reporting, and machine learning across diverse business contexts.

You will work with cloud platforms such as Azure, AWS or GCP, develop data warehouses and lakes, ensure data quality and governance, and collaborate with Data Analysts, Data Scientists, and Software

Qualifications

• 3+ years' experience in Data Engineering or a related field.
• Strong SQL development skills.
• Proficiency in Python, Scala, or similar programming languages.
• Experience building ETL/ELT pipelines.
• Experience working with cloud platforms such as Microsoft Azure, AWS, or Google Cloud Platform.
• Strong understanding of data warehousing and dimensional modelling principles.
• Experience working with large datasets in enterprise environments.
• Knowledge of source control and DevOps practices.

Responsibilities

• Design, develop, and maintain robust data pipelines and ETL/ELT processes.
• Build and optimise scalable data platforms capable of handling large volumes of structured and unstructured data.
• Integrate data from multiple internal and external sources.
• Develop and maintain data models, data warehouses, and data lakes.
• Ensure data quality, integrity, security, and governance across the data ecosystem.
• Collaborate with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to understand requirements and deliver data solutions.
• Automate data ingestion, transformation, and orchestration processes.
• Monitor, troubleshoot, and improve data platform performance and reliability.
• Contribute to cloud migration and modernisation initiatives.
• Support the implementation of best practices around DataOps, CI/CD, and data engineering standards.

Skills

SQL

Python

Scala

ETL/ELT

Cloud platforms

Data warehousing

Data governance

DevOps practices

Tools

Azure Data Factory

Azure Synapse Analytics

Databricks

Snowflake

Kafka

Airflow

SQL Server

Power BI

Job description

Senior Data Engineer

Johannesburg | Hybrid

Permanent

About the Opportunity

Our client is continually seeking talented Data Engineers to join high-performing technology teams delivering modern data solutions across a range of industries. This is an opportunity to work on cutting-edge cloud platforms, large-scale data ecosystems, and enterprise data transformation initiatives.

As a Data Engineer, you will be responsible for designing, building, and optimising scalable data pipelines and platforms that enable advanced analytics, reporting, machine learning, and business intelligence capabilities.

Key Responsibilities

• Design, develop, and maintain robust data pipelines and ETL/ELT processes.


• Build and optimise scalable data platforms capable of handling large volumes of structured and unstructured data.


• Integrate data from multiple internal and external sources.


• Develop and maintain data models, data warehouses, and data lakes.


• Ensure data quality, integrity, security, and governance across the data ecosystem.


• Collaborate with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to understand requirements and deliver data solutions.


• Automate data ingestion, transformation, and orchestration processes.


• Monitor, troubleshoot, and improve data platform performance and reliability.


• Contribute to cloud migration and modernisation initiatives.


• Support the implementation of best practices around DataOps, CI/CD, and data engineering standards.

Required Skills & Experience

• 3+ years' experience in Data Engineering or a related field.


• Strong SQL development skills.


• Proficiency in Python, Scala, or similar programming languages.


• Experience building ETL/ELT pipelines.


• Experience working with cloud platforms such as Microsoft Azure, AWS, or Google Cloud Platform.


• Strong understanding of data warehousing and dimensional modelling principles.


• Experience working with large datasets in enterprise environments.


• Knowledge of source control and DevOps practices.

Preferred Technologies

Experience with some or all of the following:

• Azure Data Factory


• Azure Synapse Analytics


• Databricks


• Microsoft Fabric


• Snowflake


• Apache Spark


• Kafka


• Airflow


• SQL Server


• Azure DevOps


• Git


• Power BI

What We're Looking For

• Strong problem-solving and analytical thinking skills.


• Passion for modern data platforms and emerging technologies.


• Excellent communication and stakeholder engagement abilities.


• Ability to work in agile, collaborative development environments.


• A proactive mindset with a focus on continuous improvement.


• Strong attention to detail and commitment to delivering quality solutions.

Nice-to-Have Experience

• Real-time and streaming data solutions.


• Data lakehouse architectures.


• CI/CD implementation for data platforms.


• Machine learning data pipelines.


• Financial services, retail, telecommunications, or enterprise consulting environments.

Why Apply?

• Work on enterprise-scale data projects.


• Exposure to modern cloud and data technologies.


• Collaborate with highly skilled engineering teams.


• Opportunities for professional development and certification.


• Flexible and dynamic working environment.