Senior Consultant Apache Kafka & Distributed Data Systems (m/f/d)

TN Germany; Frankfurt; Vor Ort; EUR 60.000 - 100.000; Vollzeit

Zusammenfassung

An established industry player is seeking a Senior Consultant specializing in Apache Kafka and Distributed Data Systems. This role involves designing and deploying customized event streaming platforms, engaging with clients to implement scalable solutions, and leading the architecture for innovative data management projects. The ideal candidate will possess a strong background in Java, Big Data technologies, and cloud solutions, thriving in an agile environment. Join a dynamic team where your expertise in cutting-edge technologies will drive impactful projects and enhance client success in a fast-paced, international setting.

Qualifikationen

• Experience with Apache Kafka and large-scale enterprise distributed data systems.
• Skills in developing solutions for Big Data and Data Analytics.

Aufgaben

• Design and implement customized event streaming platforms based on Apache Kafka.
• Engage with clients to migrate and monitor scalable data systems.

Kenntnisse

Java

Apache Kafka

Big Data Management

Data Analytics

Docker

Kubernetes

CI/CD tools (Jenkins, Maven, GIT)

Microservices Architecture

Cloud Migration

Agile Methodologies (SCRUM)

Ausbildung

Technical Degree

Tools

Apache Kafka

Spark

CockroachDB

HDFS

Hive

OpenShift

NewRelic

ELK

Splunk

Prometheus

Jobbeschreibung

Social network you want to login/join with:

Senior Consultant Apache Kafka & Distributed Data Systems (m/f/d), Frankfurt am Main

col-narrow-left

Client:

beON consult

Location:

Job Category:

Consulting

-

EU work permit required:

Yes

col-narrow-right

Job Reference:

d07c457d33e7

Job Views:

2

Posted:

25.04.2025

Expiry Date:

09.06.2025

col-wide

Job Description:

Responsibilities

• Design, architecture, administration, and deployment of customized event streaming platforms based on Apache Kafka, adhering to industry standards and utilizing the latest tools and methods.
• Engage closely with clients to prepare, plan, migrate, monitor, and implement scalable Apache Kafka and Distributed Data Systems projects, providing comprehensive consulting on current technology states.
• Lead the design and implementation of architectures for streaming platforms and use cases using open source and cloud tools, focusing on Big Data Management and Stream Processing.

Qualifications

• Technical degree or equivalent training
• Experience and knowledge in Java
• Experience with Apache Kafka and large-scale enterprise distributed data systems such as Spark, CockroachDB, HDFS, Hive, etc.
• Background in software development and automation for big data systems
• Skills in developing solutions for Big Data and Data Analytics
• Experience with system deployment and container technologies like Docker, OpenShift, Kubernetes
• Proficiency in developing resilient, scalable distributed systems and microservices architecture
• Knowledge of stream processing frameworks like Kafka Streams, Spark Streaming, Flink, Storm
• Experience with CI/CD tools such as Jenkins, Maven, GIT, etc.
• Understanding of SDLC processes, Cloud Operations, and ITIL Service Delivery
• Knowledge of authentication mechanisms like OAuth, Vert.x, Spring Boot
• Experience with SQL Azure and AWS development
• Experience with cloud migration and cloud-native solutions, including workload types, migration patterns, and tools
• Familiarity with monitoring and logging tools such as NewRelic, ELK, Splunk, Prometheus
• Ability to communicate technical ideas clearly in business language
• Interest in agile organizational structures (SCRUM)
• Customer-oriented, comfortable working in an international environment with German and English languages