Kafka CDC Engineer

Zorba Consulting; Mumbai, Delhi, Bengaluru; Hybrid; INR 2,000,000 - 3,600,000; Full time

Job summary

Zorba Consulting is seeking an experienced Kafka CDC Engineer to design and support real-time data pipelines from Oracle to Kafka and downstream platforms such as Databricks and Data Lakes.

You will configure Debezium CDC, Kafka Connect, and connectors, manage topic design, and ensure data quality, schema evolution, and production reliability across multi-site environments in India.

Qualifications

• 5-8 years of experience in Data Engineering / Streaming / CDC.
• Hands-on experience with Apache Kafka.
• Experience with Debezium CDC.
• Experience with Kafka Connect.
• Experience implementing Oracle-to-Kafka CDC pipelines.
• Strong understanding of Kafka topics, partitions, offsets, producers, consumers, and event processing.
• Experience with Oracle 19c/21c.
• Strong SQL/PLSQL skills.
• Linux and Shell Scripting experience.
• Production support, incident management, troubleshooting, and RCA.

Responsibilities

• Implement Debezium CDC for Oracle 19c/21c logs and APIs.
• Configure Kafka Connect and Debezium for Oracle-to-Kafka pipelines.
• Design and configure Kafka topics for change events.
• Manage CDC event flow from Oracle tables.
• Integrate Kafka CDC with Databricks, Data Lake and downstream platforms.
• Handle schema evolution, data validation, and transformation needs.
• Monitor Kafka topics, connectors, producers/consumers in production.
• Troubleshoot production incidents related to Kafka, Debezium, connectivity and offsets.

Skills

Apache Kafka

Debezium CDC

Kafka Connect

Oracle-to-Kafka CDC

SQL/PLSQL

Linux

Shell scripting

Data engineering

Tools

Databricks

Data Lake

AWS

Kubernetes

Confluent Platform

Job description

• We are looking for an experienced Kafka CDC Engineer with strong hands-on expertise in Apache Kafka, Kafka Connect, Debezium CDC, and Oracle.
• The candidate will be responsible for implementing and supporting real-time Change Data Capture (CDC) pipelines, enabling data movement from Oracle databases to Kafka and downstream platforms such as Databricks/Data Lakes.
• The ideal candidate should have strong understanding of Kafka topics, source/destination connectivity, event/data handling, schema evolution, and production support.

Key Responsibilities

• Implement and configure Debezium CDC for capturing changes from Oracle 19c/21c logs and APIs.
• Configure Kafka Connect and Debezium connectors for Oracle-to-Kafka data pipelines.
• Design and configure Apache Kafka topics to capture and distribute database change events.
• Manage CDC event flow from Oracle tables
• Debezium
• Kafka topics
• downstream systems.
• Configure and troubleshoot source and destination connections for Kafka-based data pipelines.
• Integrate Kafka CDC pipelines with Databricks, Data Lake, and other downstream data platforms.
• Handle schema evolution, data validation, data consistency, and transformation requirements.
• Monitor Kafka topics, connectors, consumer/producer activity, and CDC pipelines in production.
• Troubleshoot production incidents related to Kafka, Debezium, Kafka Connect, Oracle connectivity, offsets, lag, and data discrepancies.
• Perform root-cause analysis and implement permanent fixes for production issues.
• Optimize Kafka and CDC pipeline performance, throughput, and reliability.
• Develop and maintain SQL/PLSQL and Shell scripts for data validation, automation, and operational activities.
• Work with Linux environments for deployment, monitoring, troubleshooting, and automation.
• Collaborate with application, database, cloud, and data engineering teams to ensure reliable end-to-end data flow.

Mandatory Skills

• 5-8 years of relevant experience in Data Engineering / Streaming / CDC.
• Strong hands-on experience with Apache Kafka.
• Strong experience with Debezium CDC.
• Hands-on experience with Kafka Connect.
• Experience implementing Oracle-to-Kafka CDC pipelines.
• Strong understanding of Kafka topics, partitions, offsets, producers, consumers, and event processing.
• Experience with Oracle 19c/21c.
• Strong SQL/PLSQL skills.
• Good experience with Linux and Shell Scripting.
• Experience in production support, incident management, troubleshooting, and RCA.
• Strong understanding of source-to-target data flow and connectivity.
• Experience with data validation and schema evolution.

Preferred Skills

• Databricks / Data Lake AWS Kubernetes Confluent Platform CI/CD Experience with Kafka monitoring and performance tuning.
• Experience integrating Kafka CDC with cloud-based data platforms.

Location

• Pan India,Mumbai, Delhi / NCR, Bengaluru , Kolkata, Chennai, Hyderabad, Ahmedabad, Pune