GCP Data Engineer: ETL, BigQuery & Real-Time Pipelines

PBT Group

Johannesburg

On-site

ZAR 900,000 - 1,300,000

Full time

14 days+

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

PBT Group is seeking a Google Cloud Platform (GCP) Data Engineer to design, build, and optimize data pipelines and architectures on GCP. You will collaborate with data analysts, data scientists, and stakeholders to ensure high-quality data for analytics, ML, and real-time processing.

You will implement ETL/ELT pipelines, manage data warehouses and data lakes with BigQuery, Cloud Storage, Dataflow, and Cloud Composer (Airflow), and contribute to data modelling, governance, and CI/CD automation

Qualifications

Bachelor’s degree in a related field (CS/IS/Engineering).
4+ years of data engineering experience, with at least 2 years on GCP.
Strong SQL and ETL/ELT capabilities for large-scale data.
Understanding of data warehousing and dimensional modelling.
Hands-on with BigQuery or Snowflake and orchestration tools like Airflow or Argo.
Experience with real-time data processing using Kafka Streaming.
Knowledge of ML pipelines and MLOps is a plus.

Responsibilities

Design, build, and maintain scalable ETL/ELT data pipelines on GCP.
Implement and manage data warehouses and data lakes using BigQuery, Cloud Storage, Dataflow, and Cloud Composer (Airflow).
Develop and optimise data models for business needs, ensuring performance and scalability.
Collaborate with cross-functional teams to deliver tailored data access solutions.
Ensure data quality, security, and governance through tuning and capacity management.
Implement CI/CD automation using GitHub Actions and Docker to streamline deployments.
Develop and maintain documentation for data architecture and processes.
Support real-time data processing with Kafka Streaming and ML workflows.