Kafka Engineer

Fractal Analytics Ltd.; Bengaluru; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Fractal Analytics Ltd. in Bengaluru is seeking a Kafka Engineer with hands-on experience in Confluent Platform to design, build, and maintain real-time streaming pipelines across on-prem and cloud environments.

You will implement Kafka Connect, Schema Registry, KSQL, and FlinkSQL, ensure high availability, performance, and integrate pipelines with data lakes and warehouses. Collaborate with data engineers and backend teams, set up CI/CD pipelines, and implement security (SASL/SSL) and monitoring

Qualifications

• Experience in Apache Kafka and Confluent Platform.
• Experience with Kafka Connect, Kafka Streams, Schema Registry, KSQL, and FlinkSQL.
• Strong background in Java or Python.
• Good understanding of stream processing and event-driven architecture.
• Hands-on experience with cloud platforms: AWS / Azure / GCP (esp. Confluent Cloud).
• Proficient in Kafka cluster deployment, tuning, and maintenance.
• Familiarity with CI/CD, Git, Helm, and Kubernetes.
• Nice to Have Knowledge of Terraform, Pulumi, or other Infra as Code tools.
• Exposure to DataOps / Data Engineering ecosystems.

Responsibilities

• Design, build, and manage Kafka and Confluent infrastructure for high throughput streaming applications.
• Implement Kafka Connect, Schema Registry, and KSQL (KSQLDB), FlinkSQL.
• Ensure high availability, performance tuning, and monitoring of Kafka clusters.
• Collaborate with data engineers and backend teams to integrate streaming pipelines with data lakes, warehouses.
• Set up and enforce Kafka security mechanisms (SASL, SSL, ACLs, RBAC).
• Create and manage CI/CD pipelines for Kafka components using tools like Git, Jenkins, etc.
• Monitor and troubleshoot issues using tools like Confluent Control Center, DataDog.

Skills

Kafka Experience

Confluent Platform

Java or Python

Stream Processing

Cloud Platforms (AWS/Azure/GCP)

CI/CD & Git

Kubernetes

Terraform / IaC

DataOps

Tools

Kafka Connect

Schema Registry

KSQL

FlinkSQL

Git

Jenkins

Helm

Kubernetes

Job description

It’s fun to work in a company where people truly BELIEVE in what they are doing! We're committed to bringing passion and customer focus to the business. Job Summary We are looking for a skilled Kafka Engineer with hands‑on experience in Confluent Platform to design, build, and maintain high-performance, real‑time data streaming pipelines. The ideal candidate will have expertise in Kafka ecosystem components and be well‑versed in deploying and scaling Kafka clusters, both on‑prem and in cloud environments.

Key Responsibilities

• Design, build, and manage Kafka and Confluent infrastructure for high throughput streaming applications
• Implement Kafka Connect, Schema Registry, and KSQL (KSQLDB), FlinkSQL
• Ensure high availability, performance tuning, and monitoring of Kafka clusters
• Collaborate with data engineers and backend teams to integrate streaming pipelines with data lakes, warehouses.
• Set up and enforce Kafka security mechanisms (SASL, SSL, ACLs, RBAC)
• Create and manage CI/CD pipelines for Kafka components using tools like Git, Jenkins, etc.
• Monitor and troubleshoot issues using tools like Confluent Control Center, DataDog

Required Skills

• Experience in Apache Kafka and Confluent Platform
• Experience with Kafka Connect, Kafka Streams, Schema Registry, KSQL, and FlinkSQL
• Strong background in Java or Python
• Good understanding of stream processing and event-driven architecture
• Hands‑on experience with cloud platforms: AWS / Azure / GCP (esp. Confluent Cloud)
• Proficient in Kafka cluster deployment, tuning, and maintenance
• Familiarity with CI/CD, Git, Helm, and Kubernetes
• Nice to Have Knowledge of Terraform, Pulumi, or other Infra as Code tools
• Exposure to DataOps / Data Engineering ecosystems

If you like wild growth and working with happy, enthusiastic over‑achievers, you'll enjoy your career with us!

At Fractal, towards our goal of “powering every human decision in the enterprise”, our partnerships and alliances help in creating and delivering a compelling suite of solutions to unlock value. We partner with companies from around the globe, leaders in their respective fields. With Fractal’s expertise in artificial intelligence, design, engineering, and digital transformation, combined with the data, technology, and software platforms from our partners, we create cutting‑edge solutions to problems in the business world. We understand how critical and timely decision triggers, and information, empower our clients to create, unlock, deliver, and realize value. Together with our partners, our goal is to serve each client in their end‑to‑end data‑to‑decision journey.