Remote Kafka Platform Engineer - Enterprise Streaming

Bright Vision Technologies; Alpharetta (GA); Remote; USD 130,000 - 180,000; Full time

Job summary

Bright Vision Technologies is seeking a highly experienced Kafka Platform Engineer with 10+ years in distributed systems, enterprise streaming, and platform engineering to architect, deploy, and manage enterprise-scale streaming platforms powering real-time data across the organization.

This role emphasizes deep Kafka internals, platform automation, security, observability, and mentoring engineering teams, with a focus on enterprise event-streaming standards and cloud-native infrastructure.

Qualifications

• 10+ years of professional experience in distributed systems or platform engineering.
• 5+ years hands-on Apache Kafka or Confluent Platform experience.
• Expert knowledge of Kafka internals (partitions, replication, brokers, ISR, consumer groups, offset management).
• Experience implementing Kafka security (SASL, SSL/mTLS, ACLs, RBAC).
• Hands-on with Kafka Connect, Schema Registry, Kafka Streams, ksqlDB, and real-time streaming architectures.
• HA/DR, multi-cluster replication, cross-region failover experience.
• Scripting with Python/Bash/Go; IaC with Terraform/Ansible.
• Observability with Prometheus, Grafana, OpenTelemetry, ELK; distributed tracing.

Responsibilities

• Architect, deploy, and manage highly available Apache Kafka and Confluent Platform environments for enterprise-scale applications.
• Design Kafka cluster topology, broker configuration, partitioning, replication, capacity planning, and performance optimization.
• Implement security using SASL, SSL/mTLS, ACLs, RBAC; ensure encryption and authentication.
• Design and manage Kafka Connect, Schema Registry, Kafka Streams, ksqlDB pipelines for real-time data integration.
• Develop Infrastructure as Code using Terraform or Ansible to provision Kafka infrastructure.
• Design and implement HA, DR, backup, failover, and cross-region replication strategies.
• Build monitoring and observability using Prometheus, Grafana, OpenTelemetry, ELK, and Confluent tools.
• Optimize cluster performance, troubleshoot production issues, perform root-cause analysis, and drive platform improvements.
• Support Kafka deployments on Kubernetes using Strimzi, Confluent Operator, or cloud services (AWS MSK, Azure Event Hubs Kafka API, Confluent Cloud).
• Collaborate with developers, data engineers, DevOps, SRE, and enterprise architects to set standards and governance.
• Conduct architecture reviews and mentor engineers on Kafka development and operations.

Skills

Distributed systems

Platform engineering

Apache Kafka

Confluent Platform

Kafka security

Kubernetes

Terraform

Ansible

Prometheus

Grafana

OpenTelemetry

ELK

Education

Bachelor's or Master's degree in CS/Engineering

Tools

Terraform

Ansible

Kubernetes

Confluent Platform

Job description

Bright Vision Technologies is seeking a highly experienced Kafka Platform Engineer with 10+ years in distributed systems, enterprise streaming, and platform engineering to architect, deploy, and manage enterprise-scale streaming platforms powering real-time data across the organization.

This role emphasizes deep Kafka internals, platform automation, security, observability, and mentoring engineering teams, with a focus on enterprise event-streaming standards and cloud-native infrastructure.