Senior Real-Time Streaming Architect — Kappa & Kafka

Coca-Cola; Atlanta (GA); On-site; USD 152,000 - 178,000; Full time

Job summary

Coca-Cola in Atlanta, GA is seeking a Senior Data Engineer - Streaming to help evolve the enterprise data estate from batch processing to a real-time, event-driven ecosystem. You will design reusable streaming architectures, implement Kappa patterns, and enable teams to deploy robust, real-time data streams on Fabric.

The role focuses on building frameworks for backfill, replay, and governance, with emphasis on sub-second latency, idempotent processing, and scalable ingestion from Kafka

Qualifications

• 8+ years of data platform experience with streaming architectures.
• Proficient in Spark Structured Streaming, Kafka, and real-time pipelines.
• Experience with Delta Lake and streaming governance patterns.

Responsibilities

• Design and codify streaming architectures using Kappa patterns.
• Develop templates and backfill replay mechanisms with checkpoints/dedupe.
• Build dashboards and tooling for streaming health, latency, and throughput.
• Partner with teams to deploy real-time data streams on Fabric.

Skills

Scala

PySpark

Structured Streaming

Kafka

Flink

Tools

Delta Lake

Fabric Real-Time Intelligence

Job description

Coca-Cola in Atlanta, GA is seeking a Senior Data Engineer - Streaming to help evolve the enterprise data estate from batch processing to a real-time, event-driven ecosystem. You will design reusable streaming architectures, implement Kappa patterns, and enable teams to deploy robust, real-time data streams on Fabric.

The role focuses on building frameworks for backfill, replay, and governance, with emphasis on sub-second latency, idempotent processing, and scalable ingestion from Kafka