Senior Data Engineer: Real-Time Streaming & Kafka Architect

Incedo Inc.; New Jersey; On-site; USD 120,000 - 170,000; Full time

Job summary

Incedo Inc. is seeking a Senior Data Engineer specializing in event-driven architecture to lead the real-time data backbone of our platform. You will architect streaming pipelines and Kafka-based systems that move data reliably across the company—fueling analytics, ML, and real-time product features.

This senior, hands-on role requires owning architecture, setting standards, and mentoring engineers while driving the platform's streaming direction across the organization.

Qualifications

• 7+ years in data engineering or backend engineering with experience building and operating event-driven or streaming systems at scale.
• Own streaming architecture end-to-end and set technical direction.
• Deep production experience with Apache Kafka (Confluent, MSK, or self-managed).
• Strong patterns in event sourcing, CQRS, pub/sub, CDC.

Responsibilities

• Own architecture of event-driven systems and streaming data pipelines on Apache Kafka.
• Define event models, schemas, and schema-evolution strategy (Avro/Protobuf/JSON).
• Design and lead build-out of producers, consumers, connectors, and stream-processing jobs (Kafka Streams, ksqlDB, Flink, Spark).
• Set topic/partition/consumer-group strategies for scalability and fault tolerance.
• Drive adoption of event-driven patterns and ensure reliability guarantees (exactly-once/at-least-once).
• Lead production operations of Kafka—monitoring, capacity planning, tuning, incident response.
• Architect integrations with source/sink systems via Kafka Connect and Debezium tooling.
• Partner with data/product/platform leads to define event contracts and streaming standards.
• Mentor engineers and raise the technical bar for streaming across the org.

Skills

Kafka

Event-driven arch

Streaming pipelines

Java/Scala

Python

SQL

Tools

Kafka Connect

Debezium

ksqlDB

Flink

Spark Streaming

Schema Registry

Avro/Protobuf

Confluent Platform

Prometheus

Job description

Incedo Inc. is seeking a Senior Data Engineer specializing in event-driven architecture to lead the real-time data backbone of our platform. You will architect streaming pipelines and Kafka-based systems that move data reliably across the company—fueling analytics, ML, and real-time product features.

This senior, hands-on role requires owning architecture, setting standards, and mentoring engineers while driving the platform's streaming direction across the organization.