Remote Streaming Data Engineer - Kafka Platform Lead

Bright Vision Technologies; Sunnyvale (CA); On-site; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking a Streaming Data Engineer to architect, deploy, and operate large-scale Apache Kafka environments supporting mission-critical event-driven workloads. You will own the Kafka platform end-to-end, focusing on sizing, configuration, security, automation, and observability.

The ideal candidate has 5+ years of production Kafka experience, strong DevOps/SRE practices, and a track record of shipping reliable streaming solutions in a fast-moving environment.

Qualifications

• Bachelor’s degree is required.
• 5+ years of experience operating Apache Kafka or Confluent Platform in production.
• Deep knowledge of Kafka internals (partitions, replication, ISRs, consumer groups).
• Experience with Kafka security (SASL, mTLS, ACLs, RBAC).
• Hands-on with Kafka Connect, Schema Registry, and Kafka Streams or ksqlDB.
• Experience with HA/DR strategies for Kafka.
• Scripting in Python, Bash, or Go.
• Infrastructure-as-code with Terraform and Ansible.
• Observability tooling for Kafka; strong troubleshooting, communication, and documentation.

Responsibilities

• Own the Kafka platform end-to-end: sizing, configuration, security, automation.
• Collaborate with product, design, engineering, operations, and stakeholders to deliver reliable streaming platforms.
• Mentor junior engineers; contribute to design and code reviews.
• Deliver a reliable, performant streaming platform in production.

Skills

Kafka internals

DevOps / SRE practices

Troubleshooting

Communication

Documentation

Python

Bash

Go

Education

Bachelor’s degree in Computer Science, Engineering, or related technical discipline

Tools

Terraform

Ansible

Kafka Connect

Schema Registry

Kafka Streams or ksqlDB

Job description

Bright Vision Technologies is seeking a Streaming Data Engineer to architect, deploy, and operate large-scale Apache Kafka environments supporting mission-critical event-driven workloads. You will own the Kafka platform end-to-end, focusing on sizing, configuration, security, automation, and observability.

The ideal candidate has 5+ years of production Kafka experience, strong DevOps/SRE practices, and a track record of shipping reliable streaming solutions in a fast-moving environment.