Senior Kafka & Flink Streaming Architect (Confluent Cloud)

Genius Business Solutions; Columbus (OH); On-site; USD 150,000 - 210,000; Full time

Job summary

Genius Business Solutions Inc. (GBSI) is seeking a Senior Streaming Architect/Engineer to design, build, and operate our real-time data platform on Confluent Cloud and Apache Flink. You will guide cloud-native, event-driven architecture on AWS and GCP, set technical direction, and mentor engineers while interfacing with business stakeholders.

You will lead migrations from legacy systems, implement fault-tolerance, and drive observability and security across global environments.

Qualifications

• 12+ years in software, integration, or data engineering, with 5+ years hands-on Kafka/Confluent in production.
• Strong hands-on experience with Apache Flink (DataStream API and Flink SQL).
• Deep Kafka knowledge: partitioning, replication, retention, Kafka Connect, Kafka Streams, ksqlDB.
• Experience running Confluent Cloud in enterprise settings on AWS and/or GCP.

Responsibilities

• Architect multi-region, highly available Confluent Cloud environments with DR strategies (Cluster Linking, cross-region replication) for 200K+ events/sec.
• Design and build real-time pipelines in Apache Flink (DataStream, Table, and SQL APIs).
• Implement stateful, fault-tolerant processing with checkpointing, savepoints, and exactly-once semantics; optimize performance.
• Build and manage Kafka Connect source/sink connectors with SMTs and DLQ/retry patterns.
• Own schema governance through Schema Registry and compatibility rules.
• Develop event-driven microservices and Kafka Streams / ksqlDB apps using Java and Spring Boot.
• Lead migrations of on-prem workloads to Confluent Cloud and AWS with zero-downtime cutover.
• Automate infrastructure with Terraform and GitOps CI/CD (Harness, Jenkins).
• Set up secure connectivity (Private Service Connect, VPC, PrivateLink), RBAC, SSL/SASL, and audit logging.
• Lead observability (Prometheus, Grafana, CloudWatch, Splunk); drive incident response and RCA.

Skills

Confluent Kafka

Apache Flink

Kafka Streams

ksqlDB

Java

Spring Boot

Python

SQL

Terraform

Docker

Kubernetes

CI/CD

AWS

GCP

Tools

Confluent Cloud

Terraform

Docker

Kubernetes

Jenkins

Harness

Prometheus

Grafana

Splunk

Job description

Genius Business Solutions Inc. (GBSI) is seeking a Senior Streaming Architect/Engineer to design, build, and operate our real-time data platform on Confluent Cloud and Apache Flink. You will guide cloud-native, event-driven architecture on AWS and GCP, set technical direction, and mentor engineers while interfacing with business stakeholders.

You will lead migrations from legacy systems, implement fault-tolerance, and drive observability and security across global environments.