Cloud Data Engineer

DeARX; Sandton; On-site; ZAR 650,000 - 1,000,000; Full time

Job summary

DeARX is seeking an experienced Cloud Data Engineer in Sandton to design, build and optimise scalable cloud data platforms. You will create robust data pipelines for batch and real-time processing using Azure services and Databricks, while ensuring data quality, governance and security.

Ideal candidates have 2–5 years in data engineering or BI, hands-on experience with Azure Data Factory, PySpark and SQL, and a solid background in cloud data architectures.

Qualifications

• Bachelor's degree or equivalent in IT/CS.
• 2–5 years' experience in data engineering, BI, or software engineering.
• Experience building enterprise cloud data solutions.
• Familiarity with Agile delivery environments.

Responsibilities

• Design scalable cloud data pipelines for batch and real-time processing.
• Build robust ETL/ELT solutions using Azure and modern data engineering tech.
• Develop and maintain Data Lakes and Data Warehouses.
• Work with Microsoft Fabric, Azure Data Factory, Databricks and Azure services.
• Develop data ingestion frameworks for structured, semi-structured, and unstructured data.
• Implement DataOps, CI/CD pipelines and workflow orchestration.
• Ensure data quality, governance, lineage and metadata management.
• Collaborate with engineers, data scientists, architects and stakeholders to deliver data products.
• Support cloud security, data privacy and POPIA compliance.
• Monitor and optimise cloud data platforms for performance and reliability.
• Contribute to platform innovation and automation.

Skills

Azure

Azure Data Factory

Databricks

Python

PySpark

Apache Spark

SQL

Data Warehousing

Data Lakes

DataOps

CI/CD

IaC

Kafka or Azure Event Hub

Real-time processing

Metadata Management

Data Quality & Governance

Education

Bachelor's Degree in Information Technology, Computer Science or related field

Tools

Azure Synapse

Ab Initio

SAS

Denodo

DB2 Warehouse

Netezza

Job description

Are you passionate about cloud technologies, big data, and building modern data platforms? We're looking for an experienced Cloud Data Engineer to join a leading bank in Sandton and help deliver enterprise-scale cloud data solutions that power analytics, AI, and business decision-making.

If you enjoy designing high-performance data pipelines, working with Azure cloud technologies, and transforming complex data into valuable business insights, this opportunity is for you.

What You'll Be Doing

As a Cloud Data Engineer, you will be responsible for designing, building, and optimising secure, scalable cloud-based data platforms and pipelines that support the bank's data-driven strategy.

Your Responsibilities Will Include

• Designing and developing scalable cloud data pipelines for batch and real-time processing.
• Building robust ETL/ELT solutions using Azure and modern data engineering technologies.
• Developing and maintaining enterprise Data Lakes and Data Warehouses.
• Working with Microsoft Fabric, Azure Data Factory, Databricks and Azure cloud services.
• Developing data ingestion frameworks for structured, semi-structured and unstructured data.
• Implementing DataOps practices, CI/CD pipelines and workflow orchestration.
• Ensuring data quality, governance, lineage and metadata management.
• Collaborating with Software Engineers, Data Scientists, Architects and business stakeholders to deliver scalable data products.
• Supporting cloud security, data privacy and POPIA compliance.
• Monitoring and optimising cloud data platforms for performance, scalability and reliability.
• Contributing to platform innovation, automation and continuous improvement.
  
  

What You'll Need Minimum Requirements

• Bachelor's Degree in Information Technology, Computer Science or a related field.
• 2-5 years' experience in Data Engineering, Business Intelligence or Software Engineering.
• Experience building enterprise cloud data solutions.
• Experience working in Agile delivery environments.
  
  

Technical Skills

Experience With Most Of The Following Technologies

• Microsoft Azure
• Microsoft Fabric
• Azure Data Factory
• Azure Databricks
• Python
• PySpark
• Apache Spark
• SQL
• Data Warehousing
• Data Lakes
• ETL / ELT Development
• CI/CD
• DataOps
• Infrastructure as Code (IaC)
• Kafka or Azure Event Hub
• Real-time and streaming data processing
• Metadata Management
• Data Quality & Data Governance
  
  

Advantageous Experience

• Ab Initio
• Azure Synapse
• SAS
• Denodo
• DB2 Warehouse
• Netezza
  
  

If you're ready to engineer the future of cloud data platforms and make an impact in one of South Africa's leading financial institutions, we'd love to hear from you. Apply today!