Kafka & Flink Data Engineer

PBT Group; Johannesburg; On-site; ZAR 600 000 - 800 000; Full time

Job summary

A leading data solutions provider in Johannesburg seeks an experienced Data Engineer specialized in Apache Kafka and Flink. The candidate will design and optimize data pipelines while ensuring the security and scalability of data flows. Applicants should possess strong programming skills in Python, Java, or Scala and experience with cloud environments. This role is critical for building robust data processing frameworks.

Qualifications

• Strong experience in Apache Flink for real-time stream processing.
• Expertise in event-driven data pipelines using Apache Kafka.
• Solid development skills in Python, Java, or Scala.

Responsibilities

• Design, develop, and maintain high-performance data pipelines.
• Integrate and optimise data flows across multiple systems.
• Ensure reliability and security of data processing frameworks.

Skills

Apache Flink

Apache Kafka

Spring Boot

Data integration

Data modelling

Python

Java

Scala

AWS

Kubernetes

Docker

CI/CD Pipelines

Version Control

Job description

KAFKA & FLINK DATA ENGINEER required in Johannesburg.

We are looking for an experienced Data Engineer with a strong background in building and optimising data processing systems.

The ideal candidate will have proven expertise in distributed data processing, event streaming, and modern data architecture design.

Technical Requirements:

• Strong experience in Apache Flink for real-time stream processing
• Proficiency in Apache Kafka for event-driven data pipelines
• Experience with Spring Boot (microservices development and integration)
• Solid understanding of data integration, data modelling, and data quality principles
• Strong development background in Python, Java, or Scala
• Hands-on experience working within cloud or containerised environments (e.g., AWS, Kubernetes, Docker advantageous)
• Experience with CI/CD pipelines and version control (Git, Jenkins, etc.)
• Good understanding of relational and non-relational databases

Soft Skills:

• Strong analytical and problem-solving ability
• Collaborative and proactive approach within agile teams
• Good communication and documentation skills
• Ability to adapt to fast-changing technology environments

Deliverables:

• Design, develop, and maintain high-performance data pipelines and streaming solutions
• Integrate and optimise data flows across multiple systems
• Ensure scalability, reliability, and security of data processing frameworks
• Collaborate with architects and data teams to deliver robust data solutions