Real-Time Data Engineer: Kafka & Flink on Cloud

Pbt Group; Johannesburg; On-site; ZAR 600 000 - 800 000; Full time

Job summary

A technology solutions company in Johannesburg is seeking an experienced Data Engineer to design and maintain high-performance data pipelines. The ideal candidate will have strong experience with Apache Flink and Kafka, and proficiency in Python, Java, or Scala. Collaboration with data teams and a proactive, adaptable approach are essential. This role involves ensuring the reliability and scalability of data processing frameworks.

Qualifications

• Proven expertise in building and optimizing data processing systems.
• Experience with distributed data processing and event streaming.
• Strong background in modern data architecture design.

Responsibilities

• Design, develop, and maintain high-performance data pipelines and streaming solutions.
• Integrate and optimize data flows across multiple systems.
• Ensure scalability, reliability, and security of data processing frameworks.

Skills

Apache Flink

Apache Kafka

Spring Boot

Python

Java

Scala

CI/CD Pipelines

Git

Jenkins

Tools

AWS

Kubernetes

Docker

Job description

A technology solutions company in Johannesburg is seeking an experienced Data Engineer to design and maintain high-performance data pipelines. The ideal candidate will have strong experience with Apache Flink and Kafka, and proficiency in Python, Java, or Scala. Collaboration with data teams and a proactive, adaptable approach are essential. This role involves ensuring the reliability and scalability of data processing frameworks.