Senior Data Engineer

Digital Outsource Services; Cape Town; On-site; ZAR 900,000 - 1,300,000; Full time

Benefits offered by this job

Free Daily Meal

Free On-Site Gym

Group Life Cover

Medical Aid Subsidy

On-site Barista

Retirement Annuity Subsidy

Leadership Training

Referral Bonus

Employee Assistance Programme

Job summary

Digital Outsource Services in Cape Town seeks a data engineer to design and optimize cloud-based data pipelines, integrate lakehouse architectures, and drive real-time analytics.

The ideal candidate has 5+ years in data engineering, strong SQL, Python/Java/Scala, and hands-on with Redshift, Synapse, BigQuery, Kafka, Spark, and Terraform.

This role offers learning opportunities and on-site amenities, with leadership development and mentoring focus.

Qualifications

• Bachelor’s degree in a relevant field plus strong data engineering experience.
• 5+ years delivering data pipelines and data lakehouse architectures.
• Certifications in cloud data analytics are a plus.

Skills

SQL

Python

Java

Scala

CI/CD for data pipelines

Data governance

Security best practices

Leadership

Mentoring

Monitoring

Real-time analytics

Cloud data pipelines

Education

Bachelor’s degree in Computer Science or related field

5+ years data engineering

Certifications: AWS Data Analytics Specialty

Tools

AWS Redshift

Azure Synapse

Google BigQuery

Delta Lake

Apache Iceberg

Apache Hudi

Kafka

RabbitMQ

Docker

Kubernetes

Terraform

Hadoop

Spark

Flink

Lambda

Job description

* Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field (Master’s preferred).* 5+ years of experience in data engineering or related roles.* Relevant certifications (e.g., AWS Certified Data Analytics Specialty, Microsoft Certified: Azure Data Engineer, or Databricks Certified Data Engineer).* Strong expertise in SQL, including querying, optimization, and writing stored procedures.* Proven experience in cloud-based data platforms such as AWS Redshift, Azure Synapse, or Google BigQuery.* Knowledge of cloud lake house technologies (e.g., Delta Lake, Apache Iceberg, or Apache Hudi).* Hands-on experience with streaming platforms such as Kafka or RabbitMQ.* Expertise in data modelling for both on-premises and cloud-based systems.* Proficiency in Python, Java, or Scala for data engineering tasks.* Experience with CI/CD practices for data pipelines in a cloud environment.* Familiarity with data governance and security best practices in cloud environments.* Strong leadership and mentoring skills, with experience guiding junior team members.* Experience with big data technologies such as Hadoop, Spark, or Flink, especially in a cloud context.* Knowledge of containerization tools like Docker and orchestration platforms such as Kubernetes.* Expertise in monitoring and observability tools for cloud data pipelines.* Certification in cloud platforms or lake house technologies (e.g., AWS Data Analytics Specialty, Databricks Certified Data Engineer).* Background in implementing real-time analytics and event-driven architectures in the cloud.* Understanding of cost optimization strategies for cloud-based data infrastructure.* Experience in managing hybrid environments during migration from on-prem to cloud.* Hands-on experience with serverless computing in cloud such as Lambda Functions.* Hands-on experience with cloud analytics platforms such as Big Query or Databricks* Proficiency in C# for general engineering tasks.* Hashicorp Terraform for IaC workloads* Automation using shell scripts (Powershell, Bash etc)* We’re dedicated to your supergrowth. Our comprehensive learning and development programmes give you a range of resources and opportunities to expand your skills and advance your career.* Your hard work and achievements won’t go unnoticed. Our innovative Performance Tool ensures you receive regular, constructive feedback, helping you to continuously improve and reach your full potential.* Our Employee Assistance programme offers a variety of benefits which you and your family can benefit from.* Free Daily Meal* Free Massages On-site* Free On-Site Gym* Group Life Cover* Funeral Fund Benefit* Financial Services Assistance* Employee Assistance Programme* Curro School Fees Benefit* Income Continuation Benefit* Leadership Training* Referral Bonus* Medical Aid Subsidy* Free Sleep Coaching* On-site Barista* Retirement Annuity Subsidy* Team socials