Cloud Data Engineer — Pipelines, DataOps & Azure

Indsafri; South Africa; On-site; ZAR 900,000 - 1,500,000; Full time

Job summary

Indsafri seeks a Cloud Engineer to architect and optimize petabyte-scale data infrastructure, translating heterogeneous data into governed, low-latency data products. You will own end-to-end data lifecycle, from ingestion to delivery, ensuring quality, semantic consistency, and metadata integrity.

You will leverage Azure, Databricks, and Ab Initio in a hybrid cloud setting, collaborating with Data Scientists and Business Analysts to deliver secure, scalable analytics solutions while upholding

Qualifications

• Undergrad degree in CS / Eng / IT.
• 2–5 years IT/BI experience; able to coordinate others.

Responsibilities

• Architect and maintain enterprise data pipelines for ingestion and transformation.
• Manage hybrid cloud and on‑prem platforms using IaC and automation.
• Embed data quality and governance with metadata and lineage tracking.
• Collaborate with Data Scientists and Analysts to deliver scalable data solutions.
• Provide L2/L3 support and continuous optimization of data workflows.

Education

Undergraduate Degree in Computer Science, Engineering, or IT

Tools

Ab Initio

Python

PySpark

SQL

Apache Spark

Microsoft Fabric

Databricks

Azure

CI/CD

Infrastructure as Code

Netezza

Denodo

Job description

Indsafri seeks a Cloud Engineer to architect and optimize petabyte-scale data infrastructure, translating heterogeneous data into governed, low-latency data products. You will own end-to-end data lifecycle, from ingestion to delivery, ensuring quality, semantic consistency, and metadata integrity.

You will leverage Azure, Databricks, and Ab Initio in a hybrid cloud setting, collaborating with Data Scientists and Business Analysts to deliver secure, scalable analytics solutions while upholding