Remote Real-Time Data Engineer - Kafka Expert

Bright Vision Technologies; Chesterfield (MO); Remote; USD 135,000 - 160,000; Full time

Job summary

Bright Vision Technologies is seeking a Real-Time Data Engineer to architect, deploy, and operate large-scale Apache Kafka environments supporting mission-critical event-driven workloads.

You will own the Kafka platform end-to-end, including sizing, configuration, security, automation, observability, and developer enablement, partnering with cross-functional teams to deliver reliable, scalable streaming solutions.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
• Five or more years of experience operating Apache Kafka or Confluent Platform in production.
• Deep, hands‑on knowledge of Kafka internals (partitions, replication, ISRs, consumer groups).
• Strong experience with Kafka security (SASL, mTLS, ACLs, RBAC).
• Hands‑on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDB.
• Experience with HA/DR strategies for Kafka.
• Strong scripting skills in Python, Bash, or Go.
• Hands‑on experience with infrastructure‑as‑code (Terraform, Ansible).
• Working knowledge of observability tooling for Kafka.
• Excellent troubleshooting, communication, and documentation skills.

Responsibilities

• Architect, deploy, and operate large-scale Kafka/Confluent environments.
• Own Kafka platform end‑to‑end: sizing, configuration, security, automation, observability.
• Collaborate with product, design, engineering, and ops teams to deliver reliable streaming platforms.
• Mentor junior engineers and review design and code to raise engineering standards.

Skills

Kafka internals

DevOps / SRE practices

Scripting: Python/Bash/Go

Observability tooling

Troubleshooting & debugging

Documentation & communication

Education

Bachelor's degree in CS/Engineering

Tools

Kafka Connect

Schema Registry

Kafka Streams / ksqlDB

Terraform

Ansible

Kubernetes (Strimzi/Confluent Operator)

Confluent Platform

AWS MSK / Azure Event Hubs Kafka API

Job description

Bright Vision Technologies is seeking a Real-Time Data Engineer to architect, deploy, and operate large-scale Apache Kafka environments supporting mission-critical event-driven workloads.

You will own the Kafka platform end-to-end, including sizing, configuration, security, automation, observability, and developer enablement, partnering with cross-functional teams to deliver reliable, scalable streaming solutions.