Kafka & Flink Data Engineer

PBT Group; Johannesburg; On-site; ZAR 600 000 - 900 000; Full time

Job summary

A leading technology services firm in Johannesburg is seeking an experienced Data Engineer specializing in Kafka and Flink. The ideal candidate will be proficient in building and optimizing data processing systems, with expertise in distributed data processing and event streaming. Key skills include experience with Apache Flink, Kafka, and CI/CD pipelines. This role involves designing, developing, and maintaining high-performance data pipelines, integrating data flows, and ensuring the security and reliability of data systems.

Qualifications

• Strong experience in Apache Flink for real-time stream processing.
• Proficiency in Apache Kafka for event-driven data pipelines.
• Experience with Spring Boot for microservices development.
• Solid understanding of data integration and data quality principles.

Responsibilities

• Design, develop, and maintain high-performance data pipelines.
• Integrate and optimise data flows across multiple systems.
• Ensure scalability, reliability, and security of data processing frameworks.
• Collaborate with architects and data teams to deliver robust solutions.

Skills

Apache Flink

Apache Kafka

Python

Java

Scala

CI/CD pipelines

Git

Tools

AWS

Kubernetes

Docker

Spring Boot

Job description

Kafka & Flink Data Engineer required in Johannesburg.

We are looking for an experienced Data Engineer with a strong background in building and optimising data processing systems.

The ideal candidate will have proven expertise in distributed data processing, event streaming, and modern data architecture design.

Technical Requirements:

• Strong experience in Apache Flink for real-time stream processing
• Proficiency in Apache Kafka for event-driven data pipelines
• Experience with Spring Boot (microservices development and integration)
• Solid understanding of data integration, data modelling, and data quality principles
• Strong development background in Python, Java, or Scala
• Hands-on experience working within cloud or containerised environments (e.g., AWS, Kubernetes, Docker advantageous)
• Experience with CI/CD pipelines and version control (Git, Jenkins, etc.)
• Good understanding of relational and non-relational databases

Soft Skills:

• Strong analytical and problem-solving ability
• Collaborative and proactive approach within agile teamsGood communication and documentation skills
• Ability to adapt to fast-changing technology environments

Deliverables:

• Design, develop, and maintain high-performance data pipelines and streaming solutions
• Integrate and optimise data flows across multiple systems
• Ensure scalability, reliability, and security of data processing frameworks
• Collaborate with architects and data teams to deliver robust data solutions