Senior Data Engineer

Digital Outsource Services (Pty)

Cape Town

Presencial

ZAR 900.000 - 1.500.000

Tempo integral

14 dias+

Uma candidatura completa em um minuto

Currículo e carta de apresentação personalizados, prontos para serem enviados.

Passe pelos filtros ATS

Resumo da vaga

DigiOutsource in Cape Town is seeking a Senior Data Engineer to drive our transition from on-prem data infrastructure to a scalable cloud lake house. You will design robust data pipelines, model data for cloud storage, and mentor junior engineers while collaborating with global teams.

This role offers a dynamic, growth-focused environment within Super Group's digital gaming ecosystem, with exposure to latest cloud technologies and real-time analytics.

Qualificações

  • 5+ years of data engineering experience.
  • Bachelor's degree in CS or related field; master's preferred.
  • Experience with AWS Redshift, Synapse or BigQuery.
  • Strong SQL, data modeling, and stored procedures.
  • Cloud lake house tech such as Delta Lake / Iceberg / Hudi.
  • Streaming platforms Kafka or RabbitMQ.
  • CI/CD for data pipelines; security best practices.
  • Leadership and mentoring of juniors.

Responsabilidades

  • Design, build, and optimize data pipelines for on‑premises and cloud.
  • Lead migration from on‑prem to cloud lake house.
  • Develop scalable data models for cloud storage.
  • Implement streaming data solutions with Kafka/RabbitMQ.
  • Collaborate with cross‑functional teams to unify data.
  • Optimize queries and database structures.
  • Maintain ETL/ELT processes for cloud-native architectures.
  • Mentor junior team members.
  • Stay updated on cloud lake house tech.

Conhecimentos

SQL mastery
Cloud data platforms
Data modelling
Python/Java/Scala
Leadership
CI/CD for data pipelines
Security & governance

Formação

Bachelor's degree in Computer Science or related
Master's degree preferred

Ferramentas

AWS Redshift
Azure Synapse
Google BigQuery
Delta Lake
Apache Iceberg
Apache Hudi
Kafka
RabbitMQ
Docker
Kubernetes

Descrição da vaga

Kick-start your career in the online gaming world and experience the very latest in technology and innovation.

Who we are

We're part of Super Group, the NYSE-listed digital gaming company behind some of the world's leading Sports and iGaming brands.

At DigiOutsource, we bring passionate people and innovative tech together to create market-leading online gaming solutions. Our multidisciplinary teams are passionate about products, customer experience and security. We're empowered to achieve the ultimate in high-performance gaming experiences using the best technology available.

Who we're looking for

We're on a thrilling journey of growth and innovation, and we need passionate, driven individuals to join us. At DigiOutsource, every day is action-packed, and we expect you to bring your A-game. In return, you'll find a supportive environment where your skills can flourish, and your career can soar.

Ready to become a game-changer? Supercharge your career with us and be part of something extraordinary.

Why we need you

We're on a mission to create extraordinary experiences for our customers, and we believe that your unique skills, passion and superdrive will help us achieve our vision.

As a Senior Data Engineer, you'll be a key driver in our transition from an on-premises data infrastructure to a modern, scalable cloud lake house architecture. Your expertise in SQL querying, query optimization, stored procedures, data modelling, and streaming will support current operations while enabling the transformation to a cloud-first strategy. You'll play a critical role in designing and implementing a future-ready data platform, ensuring seamless integration of real-time and batch processing with the latest technologies. Additionally, you'll mentor and train junior team members, fostering their development and ensuring the team's success in this transformative journey.

What you'll be doing
  • Designing, developing, and optimizing robust data pipelines for on-premises and hybrid cloud environments.
  • Leading efforts to migrate data and systems from on-premises databases to a cloud lake house architecture.
  • Developing scalable data models for cloud-based storage and processing.
  • Implementing and managing streaming data solutions using platforms like Kafka or RabbitMQ.
  • Collaborating with cross-functional teams to integrate data from multiple sources into a unified data platform.
  • Optimizing query performance and database structures to meet evolving business needs.
  • Building and maintaining robust ETL/ELT processes to support cloud-native architectures.
  • Driving the adoption of modern data lake house technologies such as Delta Lake, Apache Iceberg, or Apache Hudi.
  • Mentoring and training junior team members to build their expertise in cloud data engineering.
  • Staying updated on emerging cloud and lake house technologies to guide the data architecture evolution.
Essential skills you'll bring to the table

The necessary skills that we require for this role include:

  • Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field (Master's preferred).
  • 5+ years of experience in data engineering or related roles.
  • Relevant certifications (e.g., AWS Certified Data Analytics Specialty, Microsoft Certified: Azure Data Engineer, or Databricks Certified Data Engineer).
  • Strong expertise in SQL, including querying, optimization, and writing stored procedures.
  • Proven experience in cloud-based data platforms such as AWS Redshift, Azure Synapse, or Google BigQuery.
  • Knowledge of cloud lake house technologies (e.g., Delta Lake, Apache Iceberg, or Apache Hudi).
  • Hands‑on experience with streaming platforms such as Kafka or RabbitMQ.
  • Expertise in data modelling for both on-premises and cloud-based systems.
  • Proficiency in Python, Java, or Scala for data engineering tasks.
  • Experience with CI/CD practices for data pipelines in a cloud environment.
  • Familiarity with data governance and security best practices in cloud environments.
  • Strong leadership and mentoring skills, with experience guiding junior team members.
Desirable skills you've got up your sleeve

It would be great if you also have some of the following skills:

  • Experience with big data technologies such as Hadoop, Spark, or Flink, especially in a cloud context.
  • Knowledge of containerization tools like Docker and orchestration platforms such as Kubernetes.
  • Expertise in monitoring and observability tools for cloud data pipelines.
  • Certification in cloud platforms or lake house technologies (e.g., AWS Data Analytics Specialty, Databricks Certified Data Engineer).
  • Background in implementing real-time analytics and event-driven architectures in the cloud.
  • Understanding of cost optimization strategies for cloud-based data infrastructure.
  • Experience in managing hybrid environments during migration from on-prem to cloud.
  • Hands‑on experience with serverless computing in cloud such as Lambda Functions.
  • Hands‑on experience with cloud analytics platforms such as Big Query or Datab
Obtenha sua revisão de currículo grátis e confidencial.

ou arraste e solte seu arquivo aqui.

Similar jobs

Vagas similares que valem a pena comparar

Data Engineer
Data Engineer

Indsafri • África do Sul

Presencial
ZAR 600.000 - 900.000
Senior Data Engineer - Cloud Data Architect & Analytics
Senior Data Engineer - Cloud Data Architect & Analytics

Boardroom Appointments • Johannesburg

Presencial
ZAR 800.000 - 1.200.000
Senior Data Engineer - Cloud Lakehouse & Real-Time Data
Senior Data Engineer - Cloud Lakehouse & Real-Time Data

DigiOutsource • Cape Town

Presencial
ZAR 600.000 - 800.000
Comprehensive learning and development programmes
Free daily meals
Free on-site gym access
+2
Principal Data Engineer
Principal Data Engineer

Placements24 • LegKraal Gate

Híbrido
ZAR 1.200.000 - 2.000.000
Health insurance
Remote work with flexible hours
Professional development budget
+1
Senior Data Engineer
Senior Data Engineer

Skywaves Rise • África do Sul

Remoto
ZAR 900.000 - 1.300.000
Competitive salary
Comprehensive benefits
Hybrid/remote work options
Senior Data Engineer — Cloud Lakehouse & Streaming
Senior Data Engineer — Cloud Lakehouse & Streaming

Digital Outsource Services (Pty) • Cape Town

Presencial
ZAR 900.000 - 1.500.000
Lead Data Engineer (Big Data Specialist)
Lead Data Engineer (Big Data Specialist)

Placements24 • Gauteng

Híbrido
ZAR 1.996.000 - 2.995.000
Competitive compensation
Full remote work
Learning and development opportunities
+2
Data Engineer Jhb - Northern Suburbs
Data Engineer Jhb - Northern Suburbs

Psybergate • Johannesburg

Presencial
ZAR 1.000.000 - 1.500.000
Senior Data Engineer
Senior Data Engineer

Indsafri • África do Sul

Presencial
ZAR 900.000 - 1.500.000
Remote Senior Data Engineer - Scalable Big Data Pipelines
Remote Senior Data Engineer - Scalable Big Data Pipelines

Placements24 • East London

Remoto
ZAR 1.200.000 - 2.000.000
Highly competitive compensation
Fully remote work with flexible hours
Professional development budget
+5