GCP Data Engineer: Scalable Pipelines & Analytics

BigTalent; Johannesburg; Vor Ort; ZAR 600.000 - 900.000; Vollzeit

Zusammenfassung

Unknown company in Johannesburg is seeking a Data Engineer specialized in Google Cloud Platform (GCP) to design, develop, and maintain robust data pipelines and cloud infrastructure solutions.

You will design and implement data pipelines using Dataflow, Pub/Sub, Composer and BigQuery, optimize ETL/ELT workflows, and ensure secure, governed data processing. Collaborate with stakeholders, monitor performance, and mentor junior staff in GCP technologies.

Qualifikationen

• Proven experience as a Data Engineer with extensive GCP expertise.
• Hands-on experience with Dataflow, Pub/Sub, Composer and BigQuery.
• Strong skills in ETL/ELT optimization, performance tuning, and security best practices.

Aufgaben

• Design and build scalable data pipelines on GCP.
• Optimize ETL/ELT processes for reliable ingestion and storage.
• Monitor pipelines, troubleshoot performance bottlenecks and data anomalies.
• Ensure data governance, security, and compliance within the GCP environment.
• Document cloud architectures, pipelines and deployment processes; mentor junior team members.

Kenntnisse

GCP expertise

Data pipeline design

ETL/ELT optimization

Problem solving

Tools

Dataflow

Pub/Sub

Composer

BigQuery

Jobbeschreibung

Unknown company in Johannesburg is seeking a Data Engineer specialized in Google Cloud Platform (GCP) to design, develop, and maintain robust data pipelines and cloud infrastructure solutions.

You will design and implement data pipelines using Dataflow, Pub/Sub, Composer and BigQuery, optimize ETL/ELT workflows, and ensure secure, governed data processing. Collaborate with stakeholders, monitor performance, and mentor junior staff in GCP technologies.