Data Platform Engineer — Build Cloud ELT Pipelines On-site

Badger Holdings (Pty) Ltd; Cape Town; On-site; ZAR 600,000 - 1,000,000; Full time

Job summary

Badger Holdings (Pty) Ltd in the Western Cape seeks an experienced Data Engineer to help modernise our data platform. You will design scalable ELT pipelines, build robust data models with dbt, and optimise Snowflake workloads to enable reliable reporting and analytics.

You will collaborate with analysts, data scientists and business teams, implementing data quality checks, governance and CI/CD practices while contributing to the migration from legacy systems to a cloud-native stack on GCP and

Qualifications

• Diploma or bachelor’s degree in CS/IT/Data Engineering or closely related field.
• At least four years of data engineering experience.
• Strong SQL skills with complex transformations and query optimization.
• Proficiency in Python or similar language for data processing.
• Experience building ELT pipelines in cloud environments (AWS, Azure or GCP).
• Hands-on experience with Snowflake or Azure Synapse.
• Experience using dbt, Airflow or Dagster.
• Experience with structured and semi-structured data (JSON, Parquet).
• Understanding of data governance, security and data quality practices.

Responsibilities

• Design and build scalable ELT pipelines from multiple sources.
• Develop and maintain data models using dbt.
• Optimise Snowflake models and workloads for performance and cost.
• Turn raw data into reliable datasets for reporting and analytics.
• Build data quality checks, monitoring and alerts.
• Help plan migration from legacy systems to the new platform.
• Apply engineering practices including testing, CI/CD and code reviews.
• Collaborate with business teams to deliver practical solutions.
• Contribute to documentation and engineering standards, mentor junior engineers.

Skills

SQL

Python

Data pipelines

Cloud platforms

Education

Bachelor's degree in CS/IT/Data Engineering

Tools

Snowflake

dbt

Airflow

Dagster

Job description

• Whatsapp
• Print
• PDF
• X
• Linked-in
• Facebook
  
  

Remuneration: market-related Location: Cape Town, George Job level: Mid Type: Permanent Reference: #BH-507 Company: Badger Holdings

Job Description

Data Engineer

George, Western Cape | On-site

Help Shape Our Next Data Platform

We’re modernising our data platform and looking for an experienced Data Engineer to help build it.

You’ll work with analysts, data scientists and business teams to build reliable pipelines, develop well-structured data models and make data easier to use across the business.

We’re moving from legacy systems to a cloud-native stack using Estuary, dbt, Google Cloud Platform (GCP) and Snowflake. There’s plenty to work through, and you’ll have a say in the architecture, tools and engineering practices we put in place.

If you enjoy getting into the detail, solving problems and seeing your work put to use, we’d like to hear from you.

What You’ll Work On

• Design and build scalable ELT pipelines that bring together data from multiple sources.
• Develop and maintain data models using dbt.
• Optimise Snowflake models and workloads for performance and cost.
• Turn raw data into reliable datasets for reporting and advanced analytics.
• Build in data quality checks, monitoring and alerts so issues are picked up early.
• Help plan and deliver the migration from legacy systems to the new platform.
• Apply sound engineering practices, including testing, CI/CD and code reviews.
• Work with technical and business teams to understand what they need and deliver practical solutions.
• Contribute to documentation and engineering standards, and support junior engineers as they develop.
  
  

What You’ll Need

• A relevant tertiary qualification: a diploma or bachelor’s degree in Computer Science, Information Technology, Information Systems, Data Engineering or a closely related field.
• At least four years’ experience in data engineering or a similar role.
• Strong SQL skills, including experience with complex transformations and query optimisation.
• Proficiency in Python or a similar language for data processing and automation.
• Experience building ELT pipelines in a cloud environment such as AWS, Azure or GCP.
• Hands-on experience with a modern data warehouse such as Snowflake or Azure Synapse.
• Experience using data transformation or orchestration tools such as dbt, Airflow or Dagster.
• Experience working with structured and semi-structured data, including JSON and Parquet.
• A sound understanding of data governance, security and data quality practices.
  
  

You should be comfortable taking responsibility for your work, explaining technical decisions and working through problems with people across the business.

Experience That Would Be Useful

• Estuary or other data integration and change data capture tools.
• Streaming technologies such as Kafka or Spark Streaming.
• BI tools such as Qlik, Power BI, Looker or Tableau.
• Qlik Replicate, Qlik Compose or similar tools.
• Agile delivery using Jira or Azure DevOps.
• DevOps practices or relevant cloud, Snowflake or dbt certifications.
  
  

What makes this role interesting:

You’ll join a growing data function at a point where your experience can help shape how the platform develops. Alongside building pipelines and models, you’ll contribute to architecture decisions, establish working practices and mentor junior engineers.

It’s an opportunity to work with a modern stack and see the effect of your work across the business.

Interested?

If this sounds like the kind of work you’d enjoy, apply today!

Posted on 26 Oct 16:06, Closing date 24 Nov