Remote Senior Kafka Platform Engineer

Bright Vision Technologies; Framingham (MA); On-site; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking an experienced Kafka Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments supporting mission-critical event-driven workloads.

You will own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement, partnering with product and engineering teams to deliver reliable, scalable streaming solutions.

Qualifications

• Bachelor’s degree in CS, Engineering, or related field.
• 5+ years operating Apache Kafka or Confluent in production.
• Deep Kafka internals knowledge: partitions, replication, ISRs, consumer groups.
• Strong Kafka security experience: SASL, mTLS, ACLs, RBAC.
• Hands-on with Kafka Connect, Schema Registry, and Kafka Streams/ksqlDB.
• Experience with HA/DR for Kafka.
• Strong scripting in Python/Bash/Go.
• IaC with Terraform or Ansible.
• Observability tooling for Kafka.
• Excellent troubleshooting and communication skills.

Responsibilities

• Architect, deploy, and operate large-scale Kafka clusters across on-prem and cloud.
• Design partitioning, replication, and topic strategies for throughput and durability.
• Implement Kafka security (SASL, mTLS, ACLs, RBAC) and IdP integration.
• Operate Schema Registry, Kafka Connect, KSQL/ksqlDB, and Kafka Streams in production.
• Build and maintain Kafka Connect pipelines across enterprise systems.
• Design HA/DR strategies including MirrorMaker 2 and multi-region patterns.
• Mentor engineers through code and design reviews.
• Maintain comprehensive architecture docs and runbooks.
• Evaluate emerging streaming tech (Pulsar, Redpanda, AWS MSK).

Skills

Kafka internals

DevOps

SRE

Python

Bash

Go

Terraform

Ansible

Kafka security

Kafka Connect

Schema Registry

KSQL/ksqlDB

HA/DR

Observability

Documentation

Communication

Education

Bachelor's degree in CS/Engineering

Tools

Strimzi

Confluent Operator

AWS MSK

Azure Event Hubs Kafka API

Job description

Bright Vision Technologies is seeking an experienced Kafka Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments supporting mission-critical event-driven workloads.

You will own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement, partnering with product and engineering teams to deliver reliable, scalable streaming solutions.