Confluent Kafka Tech Lead

Datamatics Technologies; Riyadh; Hybrid; SAR 299,000 - 450,000; Full time

Job summary

A technology solutions provider is seeking a Confluent Kafka Tech Lead to design and manage real-time data streaming solutions. This role involves leading the architecture of Kafka platforms, optimizing cluster performance, and guiding development and operations teams. The ideal candidate should have strong experience in Confluent Kafka, Java or Python, and cloud platforms. Join in a remote/on-site capacity to drive event-driven architectures.

Qualifications

• 6–7 years of overall IT experience with 4+ years in Confluent Kafka.
• Strong experience in Kafka architecture, cluster setup, design, and optimization.
• Expertise in Kafka Connect, Schema Registry, KSQL, and Kafka Streams.
• Strong programming experience in Java or Python.

Responsibilities

• Lead the design and architecture of end-to-end event streaming platforms using Confluent Kafka.
• Guide the development of Kafka producers and consumers using Java/Python.
• Ensure high availability, scalability, and resiliency of Kafka clusters.

Skills

Confluent Kafka

Java

Python

Kafka Streams

Kafka Connect

Kubernetes

AWS

Azure

GCP

Job description

Job Title: Confluent Kafka Tech Lead
Location: Remote / Onsite (As per project requirement)
Experience:7+ Years
Employment Type: Full-Time

Role Overview

We are seeking a highly skilled Confluent Kafka Tech Lead with deep expertise in designing, implementing, and managing real-time data streaming solutions. The ideal candidate will lead Kafka-based architecture design, ensure best practices, and guide the development and operations teams in implementing scalable, resilient event-driven systems.

Key Responsibilities

Kafka Architecture & Solution Design

• Lead the design and architecture of end-to-end event streaming platforms using Confluent Kafka.

• Define data streaming patterns, event models, schema registry usage, and partitioning strategies.

• Drive adoption of Kafka-centric event-driven architectures across teams.

Development & Integration

• Guide the development of Kafka producers and consumers using Java/Python.

• Implement Confluent features including KSQL, Connect, REST Proxy, Schema Registry.

• Oversee integration of Kafka with cloud platforms (Azure/AWS/GCP).

Performance, Scalability & Reliability

• Ensure high availability, scalability, and resiliency of Kafka clusters.

• Optimize throughput, partitions, replication, and retention settings.

• Implement monitoring, alerting, and logging frameworks.

Leadership & Collaboration

• Provide technical leadership to developers and DevOps teams.

• Conduct design reviews, code reviews, and mentor junior engineers.

• Work closely with Data Engineering, Platform, and Enterprise Architecture teams.

Security & Governance

• Define Kafka security standards (ACLs, RBAC, encryption, certificates).

• Ensure compliance with data governance and regulatory requirements.

Required Skills & Qualifications

• 6–7 years of overall IT experience with 4+ years in Confluent Kafka.

• Strong experience in Kafka architecture, cluster setup, design, and optimization.

• Expertise in Kafka Connect, Schema Registry, KSQL, and Kafka Streams.

• Strong programming experience in Java or Python.

• Experience with cloud (AWS/Azure/GCP) and containerization (Kubernetes/Docker).

• Understanding of event-driven architecture and distributed systems.

• Excellent leadership, communication, and problem-solving capabilities.

Preferred Qualifications

• Confluent Kafka Certification.

• Experience in large-scale, high-throughput real-time systems.

• CI/CD experience for streaming applications.