Hybrid Data Lakehouse Engineer — GCP & Open-Source Focus

Africa Practice; Johannesburg; Hybrid; ZAR 900,000 - 1,300,000; Full time

Benefits offered by this job

Competitive remuneration

Growth opportunities

Diverse and experienced team

Job summary

Africa Practice is seeking a Data Engineer to build and optimise data pipelines within a hybrid work model across Africa. You will integrate open-source tools with our GCP environment to enhance scalability while supporting analysts and data scientists in producing high-value insights for clients.

The role requires strong SQL/Python skills, experience with BigQuery and data lakehouse concepts, and a collaborative approach with internal stakeholders.

Qualifications

• Bachelor's degree in CS/IT/engineering or related quantitative field.
• Strong hands-on experience with cloud data engineering using GCP services.
• Deep proficiency with open-source data tools: Airflow, dbt, Spark or Kafka.
• Solid understanding of data modelling, ETL/ELT, and data lakehouse concepts.

Responsibilities

• Build, maintain, and optimise data pipelines and ETL/ELT processes.
• Integrate open-source tools into GCP infrastructure for scalability.
• Manage data storage, schemas and query performance (BigQuery, Cloud Storage).
• Support data scientists by preparing datasets for analytics and ML models.
• Create and monitor cloud jobs on GCP for daily ingestions.

Skills

SQL

Python

Data modelling

ETL/ELT development

GCP data services

Data storage & schemas

DevOps & CI/CD

AI coding tools

Education

Bachelor's degree in computer science or related field

Tools

Google BigQuery

Cloud Storage

Airflow

dbt

Apache Spark

Kafka

Git / GitHub Actions

Docker

Job description

Africa Practice is seeking a Data Engineer to build and optimise data pipelines within a hybrid work model across Africa. You will integrate open-source tools with our GCP environment to enhance scalability while supporting analysts and data scientists in producing high-value insights for clients.

The role requires strong SQL/Python skills, experience with BigQuery and data lakehouse concepts, and a collaborative approach with internal stakeholders.