Senior Data Engineer — Cloud Lakehouse & Streaming

Digital Outsource Services (Pty)

Cape Town

On-site

ZAR 900,000 - 1,500,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

DigiOutsource in Cape Town is seeking a Senior Data Engineer to drive our transition from on-prem data infrastructure to a scalable cloud lake house. You will design robust data pipelines, model data for cloud storage, and mentor junior engineers while collaborating with global teams.

This role offers a dynamic, growth-focused environment within Super Group's digital gaming ecosystem, with exposure to latest cloud technologies and real-time analytics.

Qualifications

  • 5+ years of data engineering experience.
  • Bachelor's degree in CS or related field; master's preferred.
  • Experience with AWS Redshift, Synapse or BigQuery.
  • Strong SQL, data modeling, and stored procedures.
  • Cloud lake house tech such as Delta Lake / Iceberg / Hudi.
  • Streaming platforms Kafka or RabbitMQ.
  • CI/CD for data pipelines; security best practices.
  • Leadership and mentoring of juniors.

Responsibilities

  • Design, build, and optimize data pipelines for on‑premises and cloud.
  • Lead migration from on‑prem to cloud lake house.
  • Develop scalable data models for cloud storage.
  • Implement streaming data solutions with Kafka/RabbitMQ.
  • Collaborate with cross‑functional teams to unify data.
  • Optimize queries and database structures.
  • Maintain ETL/ELT processes for cloud-native architectures.
  • Mentor junior team members.
  • Stay updated on cloud lake house tech.

Skills

SQL mastery
Cloud data platforms
Data modelling
Python/Java/Scala
Leadership
CI/CD for data pipelines
Security & governance

Education

Bachelor's degree in Computer Science or related
Master's degree preferred

Tools

AWS Redshift
Azure Synapse
Google BigQuery
Delta Lake
Apache Iceberg
Apache Hudi
Kafka
RabbitMQ
Docker
Kubernetes

Job description

DigiOutsource in Cape Town is seeking a Senior Data Engineer to drive our transition from on-prem data infrastructure to a scalable cloud lake house. You will design robust data pipelines, model data for cloud storage, and mentor junior engineers while collaborating with global teams.

This role offers a dynamic, growth-focused environment within Super Group's digital gaming ecosystem, with exposure to latest cloud technologies and real-time analytics.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer - Cloud Lakehouse & Real-Time Data
Senior Data Engineer - Cloud Lakehouse & Real-Time Data

DigiOutsource • Cape Town

On-site
ZAR 600,000 - 800,000
Comprehensive learning and development programmes
Free daily meals
Free on-site gym access
+2
Senior Data Engineer – Cloud Data & Real-Time Analytics
Senior Data Engineer – Cloud Data & Real-Time Analytics

SuperGroup International • Cape Town

On-site
ZAR 900,000 - 1,300,000
Free Daily Meal
Free On-Site Gym
Group Life Cover
+6
Senior Data Platform Engineer – Lakehouse & Cloud
Senior Data Platform Engineer – Lakehouse & Cloud

Blue Pearl PTY • Johannesburg

On-site
ZAR 800,000 - 1,200,000
None
Senior Data Engineer
Senior Data Engineer

Digital Outsource Services (Pty) • Cape Town

On-site
ZAR 900,000 - 1,500,000
Senior Data Engineer: Cloud & Data Warehouse Expert
Senior Data Engineer: Cloud & Data Warehouse Expert

PBT Group • Cape Town

On-site
ZAR 900,000 - 1,300,000
Senior Data Engineer
Senior Data Engineer

DigiOutsource • Cape Town

On-site
ZAR 600,000 - 800,000
Comprehensive learning and development programmes
Free daily meals
Free on-site gym access
+2
Senior Cloud Data Engineer - Remote | Lakehouse & Spark
Senior Cloud Data Engineer - Remote | Lakehouse & Spark

Hire Resolve • Cape Town

Remote
ZAR 700,000 - 950,000
Senior Cloud Data Engineer - Remote
Senior Cloud Data Engineer - Remote

Hire Resolve • Cape Town

Remote
ZAR 700,000 - 950,000
Remote Senior Data Platform Engineer: Lakehouse & Migrations
Remote Senior Data Platform Engineer: Lakehouse & Migrations

Carbon Data Solutions • South Africa

Remote
ZAR 900,000 - 1,800,000
Lakehouse Data Engineer | Azure Databricks & AI-ready Data
Lakehouse Data Engineer | Azure Databricks & AI-ready Data

PBT Group • Johannesburg

On-site
ZAR 600,000 - 1,200,000