Data Engineer: Cloud-Driven Pipelines & Analytics

Communicate Recruitment; Cape Town; On-site; ZAR 600,000 - 1,100,000; Full time

Job summary

Communicate Recruitment is seeking a skilled data engineer to design, build, and maintain scalable data pipelines in a cloud-based environment. You will optimize ETL/ELT processes, integrate data from diverse sources, and manage data warehouses and lakes while upholding governance and security standards.

You will collaborate with Data Analysts and Data Scientists to support analytics, reporting, and BI initiatives, ensuring reliable, high-performance data platforms across Azure/AWS/GCP.

Qualifications

• Experience designing, building, and maintaining data pipelines and ETL/ELT processes.
• Ability to integrate data from multiple sources and platforms.
• Knowledge of data warehouses and data lakes, governance and security.
• Proven track record with cloud data platforms (Azure/AWS/GCP).
• Experience enabling data-driven decision making with BI tools.

Responsibilities

• Design, build, and maintain scalable data pipelines.
• Develop and optimise ETL/ELT processes.
• Integrate data from multiple sources and platforms.
• Manage and enhance data warehouses and data lakes.
• Ensure data quality, governance, and security standards.
• Support analytics, reporting, and BI initiatives.
• Collaborate with Data Analysts and Data Scientists.
• Improve data processing performance and reliability.
• Contribute to cloud-based data platform development (Azure, AWS, GCP).
• Enable data-driven decision-making through trusted data.

Skills

Cloud platforms

CI/CD

PowerShell

Python

Bash

Observability

Security

Data pipelines

Data governance

Tools

Terraform

ARM

CloudFormation

Docker

Kubernetes

Job description

Communicate Recruitment is seeking a skilled data engineer to design, build, and maintain scalable data pipelines in a cloud-based environment. You will optimize ETL/ELT processes, integrate data from diverse sources, and manage data warehouses and lakes while upholding governance and security standards.

You will collaborate with Data Analysts and Data Scientists to support analytics, reporting, and BI initiatives, ensuring reliable, high-performance data platforms across Azure/AWS/GCP.