Senior Kafka Admin

Virtusa; Dubai; On-site; AED 330,000 - 441,000; Full time

Job summary

A leading technology services company is seeking a Senior Integration Consultant for overseeing the administration of Kafka clusters. Key responsibilities include deployment, cluster maintenance, and ensuring security configurations meet standards. The ideal candidate must have at least 7 years of relevant experience, including proficiency in Linux, Docker, and Ansible. This role offers competitive compensation and requires a commitment to critical production issues.

Qualifications

• 7 years of experience in Confluent Kafka/Apache Kafka cluster installation.
• Admin experience in Linux and distributed clusters.
• Experience with Ansible and DevOps for administrative activities.

Responsibilities

• Perform Admin functions setting up Kafka cluster and responsible for cluster activities.
• Deployment and management of Confluent monitoring.
• Cluster maintenance activities across all environments.
• DevOps pipeline setup—CI/CD for Kafka.
• Security configuration as per requirements.

Skills

Kafka cluster administration

Ansible

Linux

DevOps

Docker

Terraform

Education

BE or degree in Computer Science or related technical field

Tools

Prometheus

Grafana

Splunk

Kubernetes

Azure Data Bricks

Job description

Responsibilities

• Perform Admin functions setting up Kafka cluster and responsible for cluster activities (Support team) and hands‑on monitoring tool Confluent Control Centre / Cloudera Manager.
• Deployment and management of Confluent monitoring and investigation and streams‑based application problem orchestration (Kubernetes).
• Container technologies (Docker), infrastructure as code (Terraform, Concourse, Veracode).
• Service monitoring and graphing (Prometheus, Grafana, Splunk).
• Cluster maintenance activities across all environments—adding/removing nodes on prod cluster and rebalancing.
• DevOps pipeline setup—CI/CD for Kafka, Ansible deployments, Azure Data bricks, on‑premises Hadoop & Spark—all data pipelines.
• Work on Kafka prerequisites of infra and network.
• Confluent Kafka license configuration for components/nodes in UAT and PROD; non‑prod cluster activities and migration plan.
• Support and adhere to standards, make as like production; disaster recovery setup and regular failover drill runs on the cluster.
• Develop prerequisite scripts and automation scripts for health check and monitoring the cluster; automate monitoring and proactive dynamics integration from Kafka and log analyses (Splunk integration for the logs).
• Prepare and execute load/performance test of monitoring, ensure cluster healthy with the best practices.
• Security configuration and protocol as per Mashreq ISG requirements; LDAP and cluster access strategy.
• 24x7 availability for critical production issues marked Severity 1 (or P1 in Confluent terms) only—NOT Sev2 or Sev3.

Qualifications

BE or degree in Computer Science or a related technical field.

7 years of experience in Confluent Kafka/Apache Kafka cluster installation and admin experience in Linux and distributed cluster; experience in Ansible and DevOps for admin activities.

Required Experience:

Senior IC