Data Engineer

Communicate Recruitment; Cape Town; On-site; ZAR 600,000 - 1,100,000; Full time

Job summary

Communicate Recruitment is seeking a skilled data engineer to design, build, and maintain scalable data pipelines in a cloud-based environment. You will optimize ETL/ELT processes, integrate data from diverse sources, and manage data warehouses and lakes while upholding governance and security standards.

You will collaborate with Data Analysts and Data Scientists to support analytics, reporting, and BI initiatives, ensuring reliable, high-performance data platforms across Azure/AWS/GCP.

Qualifications

• Experience designing, building, and maintaining data pipelines and ETL/ELT processes.
• Ability to integrate data from multiple sources and platforms.
• Knowledge of data warehouses and data lakes, governance and security.
• Proven track record with cloud data platforms (Azure/AWS/GCP).
• Experience enabling data-driven decision making with BI tools.

Responsibilities

• Design, build, and maintain scalable data pipelines.
• Develop and optimise ETL/ELT processes.
• Integrate data from multiple sources and platforms.
• Manage and enhance data warehouses and data lakes.
• Ensure data quality, governance, and security standards.
• Support analytics, reporting, and BI initiatives.
• Collaborate with Data Analysts and Data Scientists.
• Improve data processing performance and reliability.
• Contribute to cloud-based data platform development (Azure, AWS, GCP).
• Enable data-driven decision-making through trusted data.

Skills

Cloud platforms

CI/CD

PowerShell

Python

Bash

Observability

Security

Data pipelines

Data governance

Tools

Terraform

ARM

CloudFormation

Docker

Kubernetes

Job description

Key Responsibilities

• Design, build, and maintain scalable data pipelines
• Develop and optimise ETL/ELT processes
• Integrate data from multiple sources and platforms
• Manage and enhance data warehouses and data lakes
• Ensure data quality, governance, and security standards
• Support analytics, reporting, and business intelligence initiatives
• Work closely with Data Analysts, Data Scientists, and business stakeholders
• Optimise data processing performance and reliability
• Contribute to cloud-based data platform development (Azure, AWS, or GCP)
• Enable data-driven decision-making through trusted and accessible data

Job Experience and Skills Required

• Conduct cloud platforms across Azure, AWS, or GCP
• Orchestrate seamless CI/CD performances from development to deployment
• Compose Infrastructure as Code using Terraform, ARM, or CloudFormation
• Lead container orchestration with Docker and Kubernetes
• Automate repetitive movements through PowerShell, Python, and Bash scripting
• Keep every section in tune through monitoring, logging, and observability practices
• Ensure security and compliance remain in perfect harmony with DevSecOps principles
• Fine-tune reliability, scalability, and performance to deliver a flawless production performance