Senior AWS Streaming Data Architect

Incedo Inc.; New Jersey; Hybrid; USD 180,000 - 260,000; Full time

Job summary

Incedo Inc. is seeking a Senior Data Tech Lead / Architect to drive architecture and implementation of enterprise-scale AWS streaming data platforms.

You will own design decisions for real-time and batch data solutions using Kafka/MSK, Glue, PySpark, Flink, and CDC frameworks. Ideal candidates bring 15+ years in IT, 6+ years in AWS data engineering, and elevated leadership in regulated financial services environments.

Qualifications

• 15+ years of IT experience.
• 5+ years as Data Architect / Principal Engineer / Tech Lead.
• 6+ years hands-on AWS Data Engineering.
• Strong expertise in Apache Kafka / AWS MSK and related tooling.
• Experience with AWS Glue, PySpark, Flink, and CDC frameworks.

Responsibilities

• Lead architecture and solution design for real-time and batch platforms.
• Design CDC-based ingestion using AWS DMS, Kafka/MSK, Kafka Connect, Debezium.
• Build streaming and batch pipelines with AWS Glue (PySpark) and Flink.
• Define data quality, lineage, observability, and SLA frameworks.
• Design Data Lakehouse using Iceberg, S3, and DynamoDB.
• Implement event-driven integration patterns and API data exchange.
• Collaborate with stakeholders to define technical roadmaps.
• Provide architecture governance and mentorship across teams.

Skills

AWS Data Engineering

Kafka / MSK

PySpark

Flink

CDC patterns

Event-Driven Architecture

Terraform / CDK

CI/CD & Git

Data Governance / Quality

Data Lakehouse

Tools

AWS DMS

Kafka Connect

Debezium

Apache Iceberg

S3

DynamoDB

Lake Formation

Terraform / CDK

CI/CD Pipelines

Git

Job description

Incedo Inc. is seeking a Senior Data Tech Lead / Architect to drive architecture and implementation of enterprise-scale AWS streaming data platforms.

You will own design decisions for real-time and batch data solutions using Kafka/MSK, Glue, PySpark, Flink, and CDC frameworks. Ideal candidates bring 15+ years in IT, 6+ years in AWS data engineering, and elevated leadership in regulated financial services environments.