Senior Kafka Platform Engineer – Remote

Bright Vision Technologies; Fishers (IN); Remote; USD 130,000 - 180,000; Full time

Job summary

Bright Vision Technologies is seeking a highly experienced Kafka Platform Engineer with 10+ years in distributed systems to architect, deploy, and manage enterprise-scale streaming platforms powering real-time data across the organization.

Expertise in Apache Kafka, Confluent Platform, security, observability, and cloud-native infrastructure is required, along with mentoring engineers and defining enterprise standards.

Qualifications

• 10+ years of professional experience in distributed systems, platform engineering, or infrastructure engineering.
• 5+ years hands-on Apache Kafka or Confluent Platform experience.
• Expert knowledge of Kafka internals: partitions, replication, brokers, ISR, offsets, and tuning.
• Extensive security experience using SASL, SSL/mTLS, ACLs, RBAC, and enterprise auth.
• Hands-on with Kafka Connect, Schema Registry, Kafka Streams, and ksqlDB.
• Experience with HA, DR, multi-cluster replication, and cross-region failover.

Responsibilities

• Architect, deploy, and manage highly available Kafka and Confluent Platform environments.
• Design cluster topology, partitioning, replication, capacity planning, and performance tuning.
• Implement enterprise security and authentication mechanisms.
• Design and manage streaming pipelines with Connect, Schema Registry, Streams, and ksqlDB.
• Develop IaC with Terraform, Ansible, or similar tools to provision infrastructure.
• Plan HA, DR, backups, and cross-region replication strategies.
• Build monitoring, alerting, logging, and observability with Prometheus, Grafana, OpenTelemetry, ELK.
• Optimize performance, troubleshoot production issues, and perform RCA for platform improvements.
• Support Kafka deployments on Kubernetes with Strimzi, Confluent Operator, or managed services (AWS MSK, Azure, Confluent Cloud).
• Collaborate with developers, data engineers, DevOps, SRE, and architects to set standards.
• Lead architecture reviews, governance, code reviews, and mentor engineers on Kafka.

Skills

Distributed systems

Platform engineering

Event streaming

Kafka internals

Security practices

Observability

Mentoring

Leadership

Education

Bachelor's or Master's in CS/Engineering/IT

Tools

Apache Kafka

Confluent Platform

Kafka Connect

Schema Registry

Kafka Streams

ksqlDB

Terraform

Ansible

Kubernetes

Strimzi

Confluent Operator

AWS MSK

Azure Event Hubs

Confluent Cloud

Prometheus

Grafana

OpenTelemetry

ELK

Python

Bash

Go

Job description

Bright Vision Technologies is seeking a highly experienced Kafka Platform Engineer with 10+ years in distributed systems to architect, deploy, and manage enterprise-scale streaming platforms powering real-time data across the organization.

Expertise in Apache Kafka, Confluent Platform, security, observability, and cloud-native infrastructure is required, along with mentoring engineers and defining enterprise standards.