Remote Kafka Platform Engineer (Senior, 10+ yrs)

Bright Vision Technologies; Carmel (IN); Remote; USD 130,000 - 180,000; Full time

Job summary

Bright Vision Technologies is seeking a highly experienced Kafka Platform Engineer with 10+ years in distributed systems, event streaming, and platform engineering, including Apache Kafka and the Confluent Platform. The ideal candidate will architect, deploy, and manage enterprise-scale streaming platforms powering real-time data processing across the organization.

This role requires deep expertise in Kafka internals, platform automation, security, observability, and cloud-native infrastructure,

Qualifications

• Bachelor's or Master's degree in a technical field.
• 10+ years of professional experience in distributed systems or platform engineering.
• 5+ years hands-on Apache Kafka or Confluent Platform experience.
• Deep knowledge of Kafka internals, partitions, replication, and offsets.
• Experience with Kafka security: SASL, SSL/mTLS, ACLs, RBAC.
• Hands-on with Kafka Connect, Schema Registry, Kafka Streams, ksqlDB.
• Experience with HA, DR, multi-cluster replication and cross-region failover.
• Scripting in Python/Bash/Go; IaC with Terraform/Ansible.
• Observability with Prometheus, Grafana, OpenTelemetry, ELK.
• Excellent troubleshooting, communication, and leadership.

Responsibilities

• Architect, deploy, and manage Kafka/Confluent environments for enterprise-scale streaming.
• Design topology, configure brokers, partitions, replication, and capacity planning.
• Implement enterprise security and authentication mechanisms.
• Design and manage Kafka Connect, Schema Registry, Kafka Streams, and ksqlDB pipelines.
• Develop Infrastructure as Code using Terraform/Ansible for provisioning Kafka infra.
• Implement HA, DR, backup, and cross-region replication strategies.
• Build monitoring/observability with Prometheus, Grafana, OpenTelemetry, ELK tools.
• Collaborate with developers, data engineers, DevOps, SRE, and architects to set standards.
• Mentor engineers on Kafka development and operations.

Skills

Kafka expertise

Distributed systems

Platform automation

Security & authentication

Observability

Mentoring/leadership

Communication skills

Education

Bachelor's degree

Master's degree

Tools

Apache Kafka

Confluent Platform

Kubernetes

Strimzi/Confluent Operator

Terraform

Ansible

AWS MSK

Azure Event Hubs (Kafka API)

Confluent Cloud

Kafka Connect

Schema Registry

Kafka Streams

ksqlDB

Prometheus

Grafana

OpenTelemetry

ELK

Job description

Bright Vision Technologies is seeking a highly experienced Kafka Platform Engineer with 10+ years in distributed systems, event streaming, and platform engineering, including Apache Kafka and the Confluent Platform. The ideal candidate will architect, deploy, and manage enterprise-scale streaming platforms powering real-time data processing across the organization.

This role requires deep expertise in Kafka internals, platform automation, security, observability, and cloud-native infrastructure,