Senior Data Engineer — Real-Time Data Pipelines

Hire Resolve; Johannesburg; On-site; ZAR 800,000 - 1,100,000; Full time

Job summary

A leading recruitment agency's client is seeking a Senior Data Engineer in Johannesburg. This role involves designing, building, and maintaining data pipelines for telecommunications processing. The ideal candidate will have expertise in ETL development, data modeling, and distributed data systems. Responsibilities include building scalable data pipelines, ensuring data quality, and optimizing performance. A Bachelor’s degree in a related field and experience with Apache tools are essential.

Qualifications

• Bachelor's degree in Computer Engineering, Software Engineering, Computer Science, or a related field.
• Strong experience in building data pipelines using tools such as Apache NiFi, Kafka, or similar.
• Proficiency in SQL, Python, and database administration.

Responsibilities

• Build ETL/ELT pipelines for ingesting and transforming data.
• Design and maintain real-time data flows using Apache tools.
• Monitor data pipeline health and optimize performance.

Skills

Building data pipelines

SQL

Python

Distributed data systems

Data governance

Streaming frameworks

Education

Bachelor’s degree in Computer Engineering

Software Engineering

Computer Science

Tools

Apache NiFi

Kafka

Airflow

PostgreSQL

Hive

Apache Spark

Job description

A leading recruitment agency's client is seeking a Senior Data Engineer in Johannesburg. This role involves designing, building, and maintaining data pipelines for telecommunications processing. The ideal candidate will have expertise in ETL development, data modeling, and distributed data systems. Responsibilities include building scalable data pipelines, ensuring data quality, and optimizing performance. A Bachelor’s degree in a related field and experience with Apache tools are essential.