Senior Streaming Data Engineer - Kafka & Confluent (Remote)

Bright Vision Technologies; San Diego, 4S Ranch (CA, CA); Remote; USD 78,000 - 105,000; Full time

Job summary

Bright Vision Technologies is seeking an experienced Streaming Data Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent environments supporting mission-critical event-driven workloads. You will own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement.

The ideal candidate brings strong DevOps/SRE practices and hands-on expertise with Kafka Connect, Schema Registry, and Kubernetes,

Qualifications

• Bachelor's degree in CS/Engineering or related field.
• 5+ years of experience operating Apache Kafka or Confluent Platform in production.
• Deep knowledge of Kafka internals (partitions, replication, ISRs, consumer groups).
• Experience with Kafka security (SASL, mTLS, ACLs, RBAC).
• Hands-on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDB.
• Experience with HA/DR strategies for Kafka.
• Strong scripting skills in Python, Bash, or Go; IaC with Terraform or Ansible.
• Observability tooling for Kafka; strong troubleshooting, communication, and documentation skills.

Responsibilities

• Own the Kafka platform end-to-end: sizing, configuration, security, automation, observability, and developer enablement.
• Partner with product, design, engineering, operations, and business stakeholders to deliver reliable streaming platforms.
• Raise the bar through code/design reviews and mentorship of junior engineers.

Skills

Kafka expertise

DevOps mindset

Python scripting

Bash scripting

Go scripting

Troubleshooting

Documentation

Education

Bachelor's degree in CS/Engineering

Tools

Apache Kafka / Confluent Platform

Kafka Connect

Schema Registry

Terraform

Ansible

Kubernetes (Strimzi/Confluent Operator)

RBAC/SASL/mTLS security

Observability tooling (Prometheus/Grafana)

HA/DR for Kafka

Job description

Bright Vision Technologies is seeking an experienced Streaming Data Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent environments supporting mission-critical event-driven workloads. You will own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement.

The ideal candidate brings strong DevOps/SRE practices and hands-on expertise with Kafka Connect, Schema Registry, and Kubernetes,