Senior Consultant Apache Kafka & Distributed Data Systems (m / f / d)

beON consult; Köln; Vor Ort; EUR 60.000 - 100.000; Vollzeit

Zusammenfassung

An innovative consulting firm is seeking a Senior Consultant for Apache Kafka and Distributed Data Systems. In this role, you will design and implement advanced event streaming platforms, ensuring they meet current industry standards. You will collaborate closely with clients, guiding them through the complexities of Big Data management and stream processing. This position offers the opportunity to work with cutting-edge technologies in a dynamic, agile environment, where your expertise will shape the future of data systems. Join a team that values creativity and technical excellence, and make a significant impact in the world of data analytics.

Qualifikationen

• Completed studies or comparable training with a technical background.
• Sound experience and knowledge in Java and Apache Kafka.

Aufgaben

• Design and implement architectures for streaming platforms using Apache Kafka.
• Lead customer consulting on scalable event streaming platforms.

Kenntnisse

Java

Apache Kafka

Big Data Management

Docker

Microservices Architecture

CI/CD

SQL Azure

AWS Development

Agile

Cloud Migration

Ausbildung

Technical Degree

Tools

Kubernetes

Jenkins

Maven

Prometheus

NewRelic

ELK

Jobbeschreibung

• As Senior Consultant Apache Kafka & Distributed Data Systems you will be responsible for the design, architecture, administration, and deployment of customized and advanced event streaming platforms based on Apache Kafka, current industry standards, and using the latest tools and methods.
• You are in close contact with your customer and are responsible for the preparation, planning, migration, control, monitoring and implementation of highly scalable Apache Kafka event streaming platforms or Distributed Data Systems projects and for comprehensive customer consulting on the current state of these technologies.
• As a Senior Consultant for Big Data Management and Stream Processing, your goal is to lead the design and implementation of architectures for streaming platforms and stream processing use cases using open source and cloud tools.

Qualifications

• Completed studies or comparable training with a technical background
• Sound experience and knowledge in Java
• Solid experience with Apache Kafka or similar large-scale enterprise distributed data systems with various distributed technologies e.g. Apache Kafka , Spark, CockroachDB, HDFS, Hive, etc.
• Experience in software development and automation to run big data systems
• Experience with developing and implementing complex solutions for Big Data and Data Analytics applications
• Experience in system deployment and container technology with building, managing, deploying, and release managing Docker containers and container images based on Docker, OpenShift, and / or Kubernetes
• Experience in developing resilient scalable distributed systems and microservices architecture
• Experience with various distributed technologies (e.g. Kafka , Spark, CockroachDB, HDFS, Hive, etc.)
• Experience with stream processing frameworks (e.g. Kafka Streams , Spark Streaming, Flink, Storm)
• Experience with Continuous Integration / Continuous Delivery (CI / CD) using Jenkins, Maven, Automake, Make, Grunt, Rake, Ant, GIT, Subversion, Artefactory, and Nexus.
• Understanding of SDLC processes (Agile, DevOps), Cloud Operations and Support (ITIL) Service Delivery
• Knowledge in authentication mechanism with OAuth, knowledge of Vert.x and Spring Boot
• Experience in SQL Azure and in AWS development
• Experience with DevOps transformation and cloud migration to one of AWS, Azure, Google Cloud Platform, and / or Hybrid / Private Cloud; as well as cloud-native end-to-end solutions, especially their key building blocks, workload types, migration patterns, and tools
• Experience with monitoring tools and logging systems such as NewRelic, ELK, Splunk, Prometheus, and Graylag
• Ability to communicate technical ideas in a business-friendly language
• Interest in modern organizational structure and an agile working environment (SCRUM)
• Customer-oriented and enjoy working in an international environment in German and English