Cloud Data Engineer: Build Scalable Pipelines & Insights

Wpp; Johannesburg; Vor Ort; ZAR 550.000 - 900.000; Vollzeit

Zusammenfassung

WPP Media South Africa is recruiting a Mid-Level Data Engineer to design, build, and optimize scalable ELT/ETL pipelines in a cloud-first environment. You will ingrain robust data models and secure data integrations using REST APIs and cloud services, enabling analytics across campaigns and partnerships.

You will collaborate with Analytics Engineers, BI Developers and Data Analysts to deliver trusted datasets, and contribute to CI/CD deployment and data governance practices while staying

Qualifikationen

• Bachelor's degree in a quantitative discipline or equivalent
• 3–5 years' experience in Data Engineering or Analytics Engineering
• Experience integrating APIs and third-party platforms
• Experience with modern data warehouses
• Experience supporting BI and analytics platforms

Aufgaben

• Design, develop and maintain scalable ELT/ETL pipelines using modern cloud technologies.
• Build and optimise data ingestion frameworks from first-, second- and third-party data sources.
• Develop and maintain robust data models that support analytics and reporting.
• Build and manage integrations using REST APIs, SDKs and cloud services.
• Develop reusable data transformation frameworks using dbt or equivalent tooling.
• Implement incremental processing, partitioning and performance optimisation techniques.
• Design and maintain data warehouse structures within BigQuery and other cloud environments.
• Ensure pipeline reliability through monitoring, alerting and automated testing.
• Troubleshoot production data issues and implement long-term solutions.
• Develop scalable cloud-native data solutions on Google Cloud Platform.
• Optimise BigQuery performance and manage cloud infrastructure costs.
• Build solutions using Cloud Functions, Cloud Run, Cloud Storage and Pub/Sub where appropriate.
• Implement secure access controls using IAM principles.
• Support infrastructure automation using Infrastructure-as-Code where applicable.
• Monitor platform performance and recommend improvements.

Kenntnisse

SQL (Advanced)

Python

REST APIs

JSON

Git

dbt

ETL / ELT

Data Warehousing

Incremental Processing

Data Quality Frameworks

BigQuery

Cloud Functions

Pub/Sub

IAM

Ausbildung

Bachelor's Degree in Computer Science, Information Systems, Engineering, Data Science or related

Tools

Snowflake

AWS

Terraform

Docker

Jobbeschreibung

WPP Media South Africa is recruiting a Mid-Level Data Engineer to design, build, and optimize scalable ELT/ETL pipelines in a cloud-first environment. You will ingrain robust data models and secure data integrations using REST APIs and cloud services, enabling analytics across campaigns and partnerships.

You will collaborate with Analytics Engineers, BI Developers and Data Analysts to deliver trusted datasets, and contribute to CI/CD deployment and data governance practices while staying