Cape Town Data Engineer — Hybrid, Cloud & Pipelines

Theplug; Cape Town; Hybrid; ZAR 800,000 - 1,200,000; Full time

Job summary

Theplug is seeking a Data Engineer in Cape Town for a hybrid role, requiring 3+ years of experience. You will design and operate scalable data pipelines using Python and SQL, on AWS, with Airflow, Snowflake, and PostgreSQL.

You will collaborate across data, software, and product teams to deliver reliable data solutions for analytics and reporting. You will own data ingestion, modeling and delivery while ensuring governance, quality and performance across the data stack.

Qualifications

• 3+ years of commercial Data Engineering experience.
• Strong Python and SQL coding ability.
• Experience with ETL/ELT processes and data pipelines.
• Experience with AWS or other cloud platforms.
• Experience with Airflow or other workflow orchestration tools.
• Familiarity with Snowflake and relational data warehouses.
• API development and data integration experience.
• Knowledge of data quality, governance and validation.

Responsibilities

• Design, develop and maintain scalable ETL/ELT data pipelines.
• Ingest, cleanse, transform and integrate data from multiple sources.
• Build well-structured data models for analytics and reporting.
• Develop APIs and data delivery solutions.
• Improve query performance in databases and data warehouses.
• Implement data quality checks and governance processes.
• Monitor and troubleshoot pipelines for reliable data delivery.
• Collaborate with analysts, engineers and stakeholders.

Skills

Python

SQL

ETL/ELT

AWS

Airflow

Spark

Pandas

Git

Education

B.Sc. in CS/SE or related

Tools

Snowflake

PostgreSQL

MS SQL Server

SQL Server

Job description

Theplug is seeking a Data Engineer in Cape Town for a hybrid role, requiring 3+ years of experience. You will design and operate scalable data pipelines using Python and SQL, on AWS, with Airflow, Snowflake, and PostgreSQL.

You will collaborate across data, software, and product teams to deliver reliable data solutions for analytics and reporting. You will own data ingestion, modeling and delivery while ensuring governance, quality and performance across the data stack.