Real-Time Data Engineer: Kafka Streaming Lead (Remote)

Bright Vision Technologies; Cedar Park (TX); On-site; USD 135,000 - 160,000; Full time

Job summary

Bright Vision Technologies is seeking an experienced Real-Time Data Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments for mission-critical workloads. You will own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement.

You will partner with product, design, engineering, operations, and business stakeholders to translate ambiguous requirements into well-engineered

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
• Five or more years of experience operating Apache Kafka or Confluent Platform in production.
• Deep, hands‑on knowledge of Kafka internals (partitions, replication, ISRs, consumer groups).
• Strong experience with Kafka security (SASL, mTLS, ACLs, RBAC).
• Hands‑on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDB.
• Experience with HA/DR strategies for Kafka.
• Strong scripting skills in Python, Bash, or Go.
• Hands‑on experience with infrastructure‑as‑code (Terraform, Ansible).
• Working knowledge of observability tooling for Kafka.
• Excellent troubleshooting, communication, and documentation skills.

Responsibilities

• Architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments supporting mission-critical event-driven workloads.
• Own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement.
• Partner with product, design, engineering, operations, and business stakeholders to translate ambiguous requirements into well-engineered solutions.
• Raise the bar through code review, design review, and mentorship of more junior engineers.

Skills

Kafka proficiency

DevOps collaboration

Strong communication

Documentation

Troubleshooting

Education

Bachelor’s degree in Computer Science, Engineering, or a related technical discipline

Tools

Apache Kafka

Confluent Platform

Kafka Connect

Schema Registry

Kafka Streams/ksqlDB

Terraform

Ansible

Kubernetes (Strimzi/Confluent Operator)

AWS MSK / Azure Event Hubs Kafka API

Job description

Bright Vision Technologies is seeking an experienced Real-Time Data Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments for mission-critical workloads. You will own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement.

You will partner with product, design, engineering, operations, and business stakeholders to translate ambiguous requirements into well-engineered