KAFKA Developer

Dicetek LLC; Abu Dhabi; On-site; AED 120,000 - 200,000; Full time

Job summary

A technology solutions provider is looking for a Kafka Specialist with over 5 years of experience in managing Kafka clusters and utilizing Kafka Streams. The ideal candidate will have strong technical skills in Apache Kafka, Java, and cloud platforms, along with familiarity with monitoring tools. This role involves hands-on work in production environments with a focus on reliable data streaming solutions.

Qualifications

• Minimum 5+ years of experience.
• Hands-on experience with Kafka in a production environment.
• Proficient with programming languages like Java, Python, or Scala.

Responsibilities

• Manage setup and configuration of Kafka clusters.
• Develop using Kafka producer and consumer APIs.
• Monitor and troubleshoot Kafka environments.

Skills

Apache Kafka expertise

Confluent Kafka knowledge

Java proficiency

Python or Scala skills

Monitoring tools experience

Tools

Confluent Control Center

Prometheus

Grafana

ELK Stack

Jenkins

Job description

Experience: Minimum 5+ years

Notice Period: Imm 30 days

Budget: As per market standard

Job Description

• Hands‑on experience with Apache Kafka and Confluent Kafka in a production environment, including Confluent Control Center, KSQLDB, Kafka Streams, and Kafka Connect.
• Proven experience in Kafka development—producer and consumer APIs, stream processing, and connector development.
• Experience with Kafka cluster management—setup, configuration, monitoring, and troubleshooting.
• Familiarity with distributed systems, microservices architecture, and event‑driven design patterns.
• Experience with cloud platforms (e.g., AWS, Azure) and containerization (Kubernetes) is a plus.

Technical Skills

• Proficiency in programming languages such as Java, Python, or Scala.
• Strong knowledge of Kafka internals (brokers, zookeepers, topics, partitions, offsets).
• Experience with monitoring tools (Prometheus, Grafana) and logging frameworks (Log4j, ELK Stack).
• Proficiency in using Confluent Control Center for monitoring, managing, and optimizing Kafka clusters.
• Expertise in Kafka Streams for building scalable, fault‑tolerant stream processing applications.
• Experience with KSQLDB for real‑time processing and analytics on Kafka topics.
• Strong understanding of Kafka Connect for integrating Kafka with external data sources and sinks.
• Understanding of networking, security, and compliance aspects related to Kafka.
• Familiarity with CI/CD pipelines and automation tools (Jenkins, GitLab CI).