Real-Time Kafka Data Engineer - Remote Streaming Lead

Bright Vision Technologies; Pflugerville (TX); Remote; USD 135,000 - 160,000; Full time

Job summary

Bright Vision Technologies is seeking an experienced Real-Time Data Engineer to architect, deploy, and operate large-scale Apache Kafka environments supporting mission-critical event-driven workloads. You will own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement.

The ideal candidate brings deep Kafka internals knowledge with strong DevOps/SRE practices and will partner with application teams to deliver a

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
• Five+ years of experience operating Apache Kafka or Confluent Platform in production.
• Deep, hands-on knowledge of Kafka internals (partitions, replication, ISRs, consumer groups).
• Strong experience with Kafka security (SASL, mTLS, ACLs, RBAC).
• Hands-on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDB.
• Experience with HA/DR strategies for Kafka.
• Strong scripting skills in Python, Bash, or Go.
• Hands-on experience with infrastructure-as-code (Terraform, Ansible).
• Working knowledge of observability tooling for Kafka.
• Excellent troubleshooting, communication, and documentation skills.

Responsibilities

• Architect, deploy, and operate large-scale Apache Kafka and Confluent environments.
• Own the Kafka platform end-to-end including sizing, security, automation, and observability.
• Collaborate with product, design, engineering, operations, and stakeholders to deliver reliable streaming solutions.
• Mentor junior engineers and contribute to design and code reviews.

Skills

Kafka internals

Kafka security

Kafka Connect

Schema Registry

KSQL/Streams

Terraform

Ansible

Python

Bash

Go

Kubernetes

DevOps/SRE

Observability

Communication

Documentation

Education

Bachelor’s degree in Computer Science, Engineering, or a related technical discipline

Tools

Apache Kafka

Confluent Platform

Kafka Connect

Schema Registry

Kafka Streams/ksqlDB

Kubernetes

Terraform

Ansible

Python

Bash

Go

Job description

Bright Vision Technologies is seeking an experienced Real-Time Data Engineer to architect, deploy, and operate large-scale Apache Kafka environments supporting mission-critical event-driven workloads. You will own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement.

The ideal candidate brings deep Kafka internals knowledge with strong DevOps/SRE practices and will partner with application teams to deliver a