Data Engineer - Scale ETL Pipelines & Data Lakes

ATS Client; Cape Town; On-site; ZAR 630,000 - 770,000; Full time

Job summary

ATS Client in Cape Town seeks an Intermediate Data Engineer to design, build, and maintain scalable data pipelines and infrastructure for reporting, analytics, and ML use cases.

You will collaborate with analysts, data scientists, and software engineers to ensure reliable data availability and quality across systems, while implementing governance and security best practices. The role offers a competitive package in a permanent Cape Town position.

Qualifications

• 3-5 years of experience in data engineering or a similar role.
• Strong proficiency in SQL and Python.
• Experience with ETL/ELT tools (Airflow, DBT, Talend).
• Hands-on experience with cloud platforms (AWS, Azure, or GCP).
• Familiarity with data warehousing solutions (Snowflake, BigQuery, Redshift).
• Understanding of data modeling concepts (star schema, normalization).
• Experience working with large datasets and distributed systems.
• Version control experience (Git).

Responsibilities

• Design, develop, and maintain robust ETL/ELT pipelines.
• Build and optimize data architectures (data lakes, warehouses, lakehouses).
• Ensure data quality, integrity, and availability across systems.
• Collaborate with stakeholders to understand data requirements.
• Monitor and troubleshoot data pipelines and workflows.
• Implement data governance, security, and compliance best practices.
• Optimize query performance and storage efficiency.
• Document data models, pipelines, and processes.
• Support real‑time and batch data processing solutions.

Skills

SQL

Python

ETL/ELT

Cloud platforms

Data warehousing

Data modeling

Distributed systems

Git

Tools

Airflow

DBT

Talend

AWS

Azure

GCP

Snowflake

BigQuery

Redshift

Job description

ATS Client in Cape Town seeks an Intermediate Data Engineer to design, build, and maintain scalable data pipelines and infrastructure for reporting, analytics, and ML use cases.

You will collaborate with analysts, data scientists, and software engineers to ensure reliable data availability and quality across systems, while implementing governance and security best practices. The role offers a competitive package in a permanent Cape Town position.