Senior Cloud Data Engineer: Lakehouse & Real-Time Pipelines

Digital Outsource Services; Cape Town; On-site; ZAR 600,000 - 800,000; Full time

Benefits offered by this job

Comprehensive learning programs

On-site free meals

On-site gym

Employee Assistance Programme benefits

Medical aid subsidy

Job summary

Digital Outsource Services is looking for a Senior Data Engineer to lead our transition to a modern cloud lake‑house architecture. You'll design and optimize data pipelines, manage system migrations, and mentor junior engineers.

Your role will involve ensuring seamless integration of real-time and batch data with the latest technologies. Come join us in Cape Town for a thrilling opportunity in the online gaming world!

Qualifications

• 5+ years of experience in data engineering or related roles.
• Relevant certifications (e.g., AWS Certified Data Analytics Specialty).
• Hands-on experience with cloud lake-house technologies (e.g., Delta Lake).

Responsibilities

• Designing and optimizing data pipelines for cloud environments.
• Leading migration of data to cloud lake-house architecture.
• Implementing and managing streaming data solutions.

Skills

SQL expertise

Cloud data platforms (AWS Redshift, Azure Synapse, Google BigQuery)

Data modeling

Streaming platforms (Kafka, RabbitMQ)

Python, Java, or Scala proficiency

CI/CD practices

Leadership and mentoring skills

Education

Bachelor’s degree in Computer Science, Data Engineering, or related field

Tools

Kafka

RabbitMQ

Docker

Terraform

Job description

Digital Outsource Services is looking for a Senior Data Engineer to lead our transition to a modern cloud lake‑house architecture. You'll design and optimize data pipelines, manage system migrations, and mentor junior engineers.

Your role will involve ensuring seamless integration of real-time and batch data with the latest technologies. Come join us in Cape Town for a thrilling opportunity in the online gaming world!