GCP Data Engineer: ETL Pipelines & BigQuery

dearx; Cape Town; On-site; ZAR 700,000 - 1,100,000; Full time

Job summary

dearx in Cape Town is seeking an experienced Data Engineer with strong Google Cloud experience to join a dynamic technology team on a 12-month contract.

This hands-on role focuses on cloud-based data platforms, pipelines and large datasets, delivering scalable solutions on GCP and ensuring data quality, security and performance.

You will design and optimize ETL/ELT pipelines, work with stakeholders, and collaborate with analysts and developers to meet business needs.

Qualifications

• Proven experience as a Data Engineer in an enterprise environment.
• Hands-on experience working with Google Cloud Platform (GCP).
• Strong SQL and data engineering skills.
• Hands-on experience with BigQuery.
• Strong Python experience.
• Experience building and supporting data pipelines and ETL/ELT processes.
• Experience with data modelling and data integration.
• Experience with one or more GCP data engineering services such as Dataflow, Dataproc, Cloud Composer/Airflow, Pub/Sub or similar.
• Good understanding of cloud-based data architecture and best practices.
• Experience working in Agile environments.

Responsibilities

• Design, build and maintain scalable data pipelines and data solutions on Google Cloud Platform (GCP).
• Develop and optimise ETL/ELT pipelines and data processing workflows.
• Work with large and complex datasets to support business and analytical requirements.
• Develop data integration and transformation solutions.
• Ensure data quality, reliability, security and performance.
• Collaborate with Data Engineers, Developers, Analysts and other stakeholders.
• Troubleshoot and resolve data pipeline and platform issues.

Skills

Data engineering

GCP

SQL

BigQuery

Python

ETL/ELT

Data modelling

Data integration

Agile

Tools

Dataflow

Dataproc

Cloud Composer/Airflow

Pub/Sub

Job description

dearx in Cape Town is seeking an experienced Data Engineer with strong Google Cloud experience to join a dynamic technology team on a 12-month contract.

This hands-on role focuses on cloud-based data platforms, pipelines and large datasets, delivering scalable solutions on GCP and ensuring data quality, security and performance.

You will design and optimize ETL/ELT pipelines, work with stakeholders, and collaborate with analysts and developers to meet business needs.