Senior Remote Kafka Streaming Platform Engineer

Bright Vision Technologies; Palo Alto (CA); On-site; USD 78,000 - 105,000; Full time

Job summary

Bright Vision Technologies is seeking an experienced Streaming Data Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments supporting mission-critical event-driven workloads. In this role you will own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement.

The ideal candidate will combine deep Kafka internals knowledge with strong DevOps and SRE practices, and will

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related technical discipline.
• 5+ years operating Apache Kafka or Confluent Platform in production.
• Deep knowledge of Kafka internals: partitions, replication, ISRs, consumer groups.
• Strong Kafka security: SASL, mTLS, ACLs, RBAC.
• Hands-on with Kafka Connect, Schema Registry, and Kafka Streams or ksqlDB.
• Experience with HA/DR strategies for Kafka.
• Python, Bash, or Go scripting.
• Infrastructure-as-code: Terraform, Ansible.
• Observability tooling for Kafka.
• Excellent troubleshooting, communication, and documentation.

Responsibilities

• Own the Kafka platform end-to-end: sizing, configuration, security, automation, observability.
• Architect, deploy, and operate large-scale Apache Kafka and Confluent environments.
• Partner with product, design, engineering, operations, and stakeholders.
• Drive reliable, performant streaming platforms and developer enablement.
• Mentor junior engineers and contribute to design/review processes.

Skills

Kafka ops

Kafka internals

Kafka security

Kafka Connect

Schema Registry

ksqlDB

HA/DR

Python

Bash

Go

Terraform

Ansible

Observability

Troubleshooting

Documentation

Communication

Education

Bachelor’s degree in Computer Science, Engineering, or related technical discipline

Tools

Kafka Connect

Schema Registry

ksqlDB

Confluent Platform

Terraform

Ansible

Kubernetes

AWS MSK

Job description

Bright Vision Technologies is seeking an experienced Streaming Data Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments supporting mission-critical event-driven workloads. In this role you will own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement.

The ideal candidate will combine deep Kafka internals knowledge with strong DevOps and SRE practices, and will