Streaming Data Engineer

Bright Vision Technologies; United States; Remote; USD 78,000 - 105,000; Full time

Job summary

Bright Vision Technologies is hiring a Streaming Data Engineer for a 100% remote role in the U.S. You will own end-to-end Kafka/Confluent Platform environments for mission-critical, event-driven workloads, focusing on performance, security, automation, observability, and developer enablement.

The role requires a BS in CS/Engineering and 5+ years of production Kafka experience, with deep knowledge of partitions, replication, ISRs, and consumer groups, plus strong scripting and IaC skills.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical discipline.
• 5+ years of experience operating Apache Kafka or Confluent Platform in production.
• Deep knowledge of Kafka internals: partitions, replication, ISRs, and consumer groups.
• Strong experience with Kafka security: SASL, mTLS, ACLs, and RBAC.
• Hands-on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksQDB.
• Experience implementing HA/DR strategies for Kafka.
• Strong scripting skills in Python, Bash, or Go.
• Hands-on experience with infrastructure-as-code using Terraform and Ansible.
• Working knowledge of observability tooling for Kafka.
• Excellent troubleshooting, communication, and documentation skills.

Responsibilities

• Architect, deploy, and operate large-scale Apache Kafka and Confluent Platform for mission-critical, event-driven workloads.
• Own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement.
• Partner with application teams to deliver a reliable, high-performing, and developer-friendly streaming platform.
• Collaborate with cross-functional partners to translate ambiguous requirements into well-engineered solutions.
• Raise the bar through code review, design review, and mentorship of more junior engineers.

Skills

Kafka

Confluent Platform

Cluster sizing

Security

Automation

Observability

Developer enablement

Python

Bash

Go

Terraform

Ansible

Kafka Connect

Schema Registry

ksqlDB

Education

Bachelor’s degree in Computer Science or Engineering

Tools

Kubernetes

Strimzi

Confluent Operator

AWS MSK

Azure Event Hubs Kafka API

Job description

Bright Vision Technologies is hiring a Streaming Data Engineer for a 100% remote role in the U.S. This position focuses on building and running large-scale Apache Kafka and Confluent Platform environments for mission-critical, event-driven workloads. You will own the Kafka platform end-to-end, with responsibility across performance, security, automation, observability, and developer enablement.

What you’ll do

• Architect, deploy, and operate large-scale Apache Kafka and Confluent Platform for mission-critical, event-driven workloads.
• Own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement.
• Partner with application teams to deliver a reliable, high-performing, and developer-friendly streaming platform.
• Collaborate with cross-functional partners across product, design, engineering, operations, and business stakeholders to translate ambiguous requirements into well-engineered solutions.
• Raise the bar through code review, design review, and mentorship of more junior engineers.

What you bring

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
• 5+ years of experience operating Apache Kafka or Confluent Platform in production.
• Deep, hands-on knowledge of Kafka internals: partitions, replication, ISRs, and consumer groups.
• Strong experience with Kafka security: SASL, mTLS, ACLs, and RBAC.
• Hands-on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDB.
• Experience implementing HA/DR strategies for Kafka.
• Strong scripting skills in Python, Bash, or Go.
• Hands-on experience with infrastructure-as-code using Terraform and Ansible.
• Working knowledge of observability tooling for Kafka.
• Excellent troubleshooting, communication, and documentation skills.

Nice to have

• Confluent Certified Administrator or Developer credentials.
• Experience operating Kafka on Kubernetes using Strimzi or Confluent Operator.
• Exposure to managed Kafka services such as AWS MSK or Azure Event Hubs Kafka API.
• Familiarity with stream processing frameworks including Flink or Spark Streaming.
• Experience with data governance and lineage for streaming data.

Compensation & location

Location: Remote (U.S.)

Salary: USD 78,000 - 105,000 per year

Visa sponsorship

U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.