Job Description Confluent Cloud & Kafka
Experience: 10- 15 Years
Location: Bangalore/Chennai
Work Mode: WFO
Shift: General Shift
Movate is looking for a Senior Confluent Cloud Kafka & Flink Engineer to design, develop and implement enterprise-scale real-time data streaming platforms and event-driven solutions. The role will translate business use cases into secure, reliable and production-grade streaming architectures using Confluent Cloud, Apache Kafka, Confluent Cloud for Apache Flink and modern cloud data platforms. The ideal candidate is a hands-on Confluent specialist with strong solution-architecture capability, deep streaming engineering experience and the ability to independently design, build, deploy and support complete real-time data solutions, rather than focusing only on Kafka administration.
Key Responsibilities
- Lead the architecture, design and implementation of enterprise-scale streaming solutions using Confluent Cloud, Apache Kafka and Confluent Cloud for Apache Flink.
- Design Kafka topics, producers, consumers, partitions and replication strategies for scalable and reliable event processing.
- Build and manage Kafka Connect integrations, managed connectors and Change Data Capture (CDC) pipelines.
- Develop Flink SQL solutions for streaming transformations, joins, aggregations, windowing and event-time processing.
- Configure and optimize Confluent Flink compute pools, materialized tables and streaming workloads.
- Implement Confluent Tableflow integrations with Apache Iceberg, Delta Lake and cloud data platforms.
- Design schemas using Avro, JSON Schema and Protobuf, and manage compatibility, versioning and schema evolution through Schema Registry.
- Establish stream governance using Stream Catalog, Stream Lineage, data contracts and enterprise governance practices.
- Automate Confluent Cloud infrastructure and environment management using the Confluent Terraform Provider.
- Integrate streaming deployments with CI/CD pipelines and implement repeatable DevOps practices across environments.
- Implement security controls using RBAC, ACLs, service accounts, API keys and secure REST API integrations.
- Design and support Cluster Linking and Schema Linking for multi-cluster and cross-environment streaming requirements.
- Deliver end-to-end use cases involving CDC, streaming ETL, real-time analytics, event-driven architectures and data-lake integration.
- Troubleshoot production issues and improve platform monitoring, performance, reliability, scalability and cost efficiency.
- Provide technical leadership, architecture guidance, code/design reviews and knowledge sharing across engineering teams.
Required Technical Skills
- 10+ years of overall engineering experience with strong hands-on experience in Confluent Cloud and Apache Kafka.
- Strong hands-on experience with Confluent Cloud for Apache Flink and Flink SQL.
- Deep understanding of Kafka topics, producers, consumers, partitioning, Kafka Connect, managed connectors and CDC.
- Experience with streaming transformations, joins, aggregations, windowing and event-time processing.
- Experience with Schema Registry, Avro, JSON Schema, Protobuf, schema compatibility, versioning and evolution.
- Hands-on experience with Terraform, preferably the Confluent Terraform Provider, infrastructure automation and CI/CD pipelines.
- Experience implementing Kafka security using RBAC, ACLs, service accounts and API keys.
- Good understanding of Cluster Linking, Schema Linking and multi-environment streaming architectures.
- Proficiency in SQL and working knowledge of Java or Python.
- Proven experience designing and delivering production-grade streaming use cases.
- Strong troubleshooting, architecture, problem-solving, communication and stakeholder-management skills.
Preferred Skills
- Knowledge of Confluent Tableflow and integration with Apache Iceberg or Delta Lake.
- Experience with AWS, Microsoft Azure or Google Cloud Platform.
- Exposure to Databricks and modern lakehouse architectures.
- Confluent certifications or relevant streaming-platform credentials.
- Experience optimizing streaming-platform performance, reliability and cloud cost.
- Prior technical leadership, architecture ownership, mentoring or cross-team enablement experience.
Qualifications
- Bachelor's degree in Computer Science, Engineering or a related discipline, or equivalent practical experience.
- Ability to translate business requirements into end-to-end real-time streaming architectures.
- Ability to independently design, develop, deploy and support enterprise-grade streaming solutions