Data Engineer: Real-Time Pipelines & Scalable Data

Digital Outsource Services; Cape Town; On-site; ZAR 720,000 - 1,080,000; Full time

Benefits offered by this job

Free Daily Meals

Free Massages On-site

Free On-Site Gym

Group Life Cover

Funeral Fund Benefit

Financial Services Assistance

Employee Assistance Programme

Curro School Fees Benefit

Income Continuation Benefit

Leadership Training

Referral Bonus

Medical Aid Subsidy

Free Sleep Coaching

On-site Barista

Retirement Annuity Subsidy

Team socials

Job summary

Digital Outsource Services in Cape Town seeks a data engineer with 3-4 years of experience to design and maintain robust data pipelines. You will work with SQL, Python/Java, and cloud services to ensure data accuracy and reliability across real-time and batch processing, leveraging Kafka/RabbitMQ for streaming and ETL workflows.

Applicants should have a Bachelor’s degree in a related field, familiarity with Spark/Hadoop, and data formats like JSON/Parquet.

Qualifications

• Bachelor’s degree in a related field (CS, Data Engineering, IS).
• 3-4 years of experience in data engineering or related roles.
• Strong SQL skills for querying and optimizing databases.
• Experience building real-time and batch data pipelines.
• Hands-on with data streaming platforms like Kafka or RabbitMQ.
• Familiarity with ETL processes and tools.
• Proficiency in Python or Java for data tasks.
• Knowledge of relational data modelling basics.
• Attention to detail and data accuracy.
• Problem-solving to troubleshoot data systems.
• Familiarity with cloud services (AWS/Azure/Google Cloud).
• Exposure to Spark or Hadoop for big data processing.
• Experience with data formats like JSON or Parquet.
• Writing clean, modular code for data processing and API/cloud integrations.
• Basic understanding of Docker containers.
• Interest in learning emerging data technologies.
• Company offers Learning and Development programmes and feedback tools.
• Employee benefits and on-site perks listed in the ad.

Skills

SQL

Data pipelines

Python/Java

Cloud platforms

Data modelling

Data governance

Big data (Spark/Hadoop)

JSON/Parquet formats

Problem solving

Docker

Education

Bachelor’s degree in Computer Science / Data Engineering / Information Systems

Tools

Kafka

RabbitMQ

Airflow

Spark

Hadoop

Docker

Job description

Digital Outsource Services in Cape Town seeks a data engineer with 3-4 years of experience to design and maintain robust data pipelines. You will work with SQL, Python/Java, and cloud services to ensure data accuracy and reliability across real-time and batch processing, leveraging Kafka/RabbitMQ for streaming and ETL workflows.

Applicants should have a Bachelor’s degree in a related field, familiarity with Spark/Hadoop, and data formats like JSON/Parquet.