Senior Real-Time Kafka & Flink Architect

TechDigital Group; Columbus (OH); Sur place; USD 180 000 - 280 000; Plein temps

Résumé du poste

TechDigital Group in Columbus, OH seeks a Senior Streaming Architect to design and run an enterprise real-time data platform on Confluent Cloud and Flink. You will lead the move from legacy batch workloads to a cloud-native, event-driven architecture on AWS and GCP, setting technical direction and mentoring engineers.

You will own multi-region Confluent Cloud environments, implement stateful processing with checkpointing, and drive migrations with zero-downtime cutover while coordinating with

Qualifications

• 12+ years in software, integration, or data engineering with production Kafka/Confluent.
• Hands-on with Apache Flink, state management, and checkpoint tuning.
• Strong knowledge of Confluent Cloud in enterprise AWS/GCP environments.
• Advanced Java (11+) and Spring Boot; Python and SQL proficient.

Responsabilités

• Architect multi-region Confluent Cloud environments with DR for 200K+ events/sec.
• Design real-time pipelines in Flink using DataStream, Table, and SQL APIs.
• Implement exactly-once semantics, stateful processing, and performance tuning.
• Develop Kafka Connect sources/sinks with CDC, S3, and analytics platforms.
• Lead migrations of on-prem workloads to Confluent Cloud and AWS with zero-downtime.
• Build event-driven microservices with Kafka Streams/ksqlDB in Java/Spring Boot.
• Establish schema governance with Schema Registry and enforce compatibility.

Connaissances

Kafka

Confluent Cloud

Apache Flink

Java & Spring

AWS & GCP

Terraform

Kubernetes

Data Streaming

SQL

Schema Registry

Outils

Terraform

Kafka Connect

KSQLDB

Jenkins

Harness

GKE

OpenShift

Description du poste

TechDigital Group in Columbus, OH seeks a Senior Streaming Architect to design and run an enterprise real-time data platform on Confluent Cloud and Flink. You will lead the move from legacy batch workloads to a cloud-native, event-driven architecture on AWS and GCP, setting technical direction and mentoring engineers.

You will own multi-region Confluent Cloud environments, implement stateful processing with checkpointing, and drive migrations with zero-downtime cutover while coordinating with