Remote Real-Time Data Engineer – Kafka & Streaming

Bright Vision Technologies; Round Rock (TX); On-site; USD 135,000 - 160,000; Full time

Job summary

Bright Vision Technologies is seeking an experienced Real-time Data Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments for mission-critical workloads. You will own the Kafka platform end-to-end, including sizing, configuration, security, automation, observability, and developer enablement.

The ideal candidate combines deep Kafka internals knowledge with strong DevOps/SRE practices and will collaborate with cross-functional teams to deliver

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical discipline.
• Five or more years of experience operating Apache Kafka or Confluent Platform in production.
• Deep, hands-on knowledge of Kafka internals (partitions, replication, ISRs, consumer groups).
• Strong experience with Kafka security (SASL, mTLS, ACLs, RBAC).
• Hands-on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDB.
• Experience with HA/DR strategies for Kafka.
• Strong scripting skills in Python, Bash, or Go.
• Hands-on experience with infrastructure-as-code (Terraform, Ansible).
• Working knowledge of observability tooling for Kafka.
• Excellent troubleshooting, communication, and documentation skills.

Responsibilities

• Architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments.
• Own the Kafka platform end-to-end, including sizing, configuration, security, automation, observability, and developer enablement.
• Translate ambiguous requirements into well-engineered solutions and mentor junior engineers.
• Partner with product, design, engineering, operations, and business stakeholders to deliver reliable streaming platforms.

Skills

Kafka internals

Kafka security

Kafka Connect

Schema Registry

Kafka Streams/ksqlDB

HA/DR

Scripting (Python/Bash/Go)

IaC (Terraform/Ansible)

Observability tooling

Troubleshooting

Education

Bachelor's degree in CS/Engineering or related field

Job description

Bright Vision Technologies is seeking an experienced Real-time Data Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments for mission-critical workloads. You will own the Kafka platform end-to-end, including sizing, configuration, security, automation, observability, and developer enablement.

The ideal candidate combines deep Kafka internals knowledge with strong DevOps/SRE practices and will collaborate with cross-functional teams to deliver