Data Platform Engineer - Dagster & Python

Shop2Shop

Stellenbosch

Hybrid

ZAR 600,000 - 1,000,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Shop2Shop in Stellenbosch, South Africa, seeks a Data Engineer to design, build and maintain a modern data platform using Python and Dagster, delivering reliable data pipelines and governance. You will work with data analysts, DevOps and business stakeholders to translate data requirements into scalable solutions, focusing on data quality, lineage and observability.

The role offers a hybrid working model with regular in-office collaboration in Stellenbosch, and opportunities to experiment with

Qualifications

  • 3–5 years of professional software or data engineering experience.
  • Experience building, deploying and supporting production data pipelines with Dagster or similar tool.
  • Strong Python programming and ETL/ELT design skills.
  • Experience with data modeling and cloud data warehouses.
  • Familiarity with data validation/testing (e.g., Pytest) and CI/CD pipelines.
  • Awareness of data privacy (POPIA) and data governance.

Responsibilities

  • Design, build and maintain robust, declarative assets and graphs in Dagster.
  • Write clean Python to extract, transform and load data into the warehouse.
  • Implement data validation, testing and monitoring to ensure quality before reporting.
  • Own day-to-day pipeline operations, including failures, reruns and backfills.
  • Integrate Dagster with the broader data stack (dbt, DuckDB, Athena, PostgreSQL, Terraform).
  • Automate deployments using Docker, Kubernetes and GitLab CI.

Skills

Python
Data engineering
Dagster
Data pipelines
Data quality
AI tools curiosity

Education

Relevant IT qualification or equivalent practical experience

Tools

Dagster
Airflow
Prefect
dbt
Docker
Kubernetes
Terraform
Athena
Snowflake
BigQuery
Redshift
DuckDB

Job description

Shop2Shop in Stellenbosch, South Africa, seeks a Data Engineer to design, build and maintain a modern data platform using Python and Dagster, delivering reliable data pipelines and governance. You will work with data analysts, DevOps and business stakeholders to translate data requirements into scalable solutions, focusing on data quality, lineage and observability.

The role offers a hybrid working model with regular in-office collaboration in Stellenbosch, and opportunities to experiment with

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Shop2Shop • Stellenbosch

Hybrid
ZAR 600,000 - 1,000,000
Senior Data Engineer - Big Data Platforms
Senior Data Engineer - Big Data Platforms

Placements24 • Stellenbosch

Hybrid
ZAR 900,000 - 1,300,000
Performance bonuses
Health insurance
Retirement plan
+3
Data Engineer - Big Data Platforms
Data Engineer - Big Data Platforms

Placements24 • Stellenbosch Local Municipality

Hybrid
ZAR 480,000 - 800,000
Medical aid
Provident fund
Paid vacation time
+2
Data Platform Engineer | SQL, Python & Power BI
Data Platform Engineer | SQL, Python & Power BI

Salt Digital Recruitment • Cape Town

On-site
ZAR 600,000 - 900,000
Data Engineer
Data Engineer

AES Global (South Africa) • Cape Town

Hybrid
ZAR 600,000 - 900,000
Remote Senior Python Data Engineer - ETL & Data Platforms
Remote Senior Python Data Engineer - ETL & Data Platforms

Placements24 • South Africa

Remote
ZAR 900,000 - 1,300,000
Competitive compensation
Performance-based bonuses
Remote-friendly within South Africa
+1
Senior Data Engineer
Senior Data Engineer

Placements24 • Paarl

Hybrid
ZAR 900,000 - 1,200,000
Competitive salary and benefits
Health and wellness benefits
Retirement savings plan
+4
Data Engineer
Data Engineer

Parvana • Kraaifontein

Hybrid
ZAR 650,000 - 900,000
Senior Data Engineer
Senior Data Engineer

Placements24 • Vereeniging

On-site
ZAR 700,000 - 1,100,000
Competitive salary package and bonus
Comprehensive health, dental, and退休/RE
Opportunities for professional develop
Data Engineer
Data Engineer

Communicate Recruitment • Johannesburg

On-site
ZAR 900,000 - 1,000,000