Senior Technical Architect

Incedo Inc.; New Jersey; Hybrid; USD 180,000 - 260,000; Full time

Job summary

Incedo Inc. is seeking a Senior Data Tech Lead / Architect to drive architecture and implementation of enterprise-scale AWS streaming data platforms.

You will own design decisions for real-time and batch data solutions using Kafka/MSK, Glue, PySpark, Flink, and CDC frameworks. Ideal candidates bring 15+ years in IT, 6+ years in AWS data engineering, and elevated leadership in regulated financial services environments.

Qualifications

• 15+ years of IT experience.
• 5+ years as Data Architect / Principal Engineer / Tech Lead.
• 6+ years hands-on AWS Data Engineering.
• Strong expertise in Apache Kafka / AWS MSK and related tooling.
• Experience with AWS Glue, PySpark, Flink, and CDC frameworks.

Responsibilities

• Lead architecture and solution design for real-time and batch platforms.
• Design CDC-based ingestion using AWS DMS, Kafka/MSK, Kafka Connect, Debezium.
• Build streaming and batch pipelines with AWS Glue (PySpark) and Flink.
• Define data quality, lineage, observability, and SLA frameworks.
• Design Data Lakehouse using Iceberg, S3, and DynamoDB.
• Implement event-driven integration patterns and API data exchange.
• Collaborate with stakeholders to define technical roadmaps.
• Provide architecture governance and mentorship across teams.

Skills

AWS Data Engineering

Kafka / MSK

PySpark

Flink

CDC patterns

Event-Driven Architecture

Terraform / CDK

CI/CD & Git

Data Governance / Quality

Data Lakehouse

Tools

AWS DMS

Kafka Connect

Debezium

Apache Iceberg

S3

DynamoDB

Lake Formation

Terraform / CDK

CI/CD Pipelines

Git

Job description

Hiring: Senior Data Tech Lead / Architect - AWS Streaming Data Platform

Location: Florham Park, NJ / Austin, TX (Local Candidates Preferred)

About the Role

We are looking for a Senior Data Tech Lead / Architect to drive the architecture, design, and implementation of enterprise-scale AWS streaming data platforms. This role requires a hands-on technical leader with deep expertise in AWS, Kafka/MSK, AWS Glue, PySpark, Flink, CDC frameworks, and Event-Driven Architecture.

The ideal candidate will have architect-level ownership experience building scalable, real-time data platforms within Wealth Management, Asset Management, Capital Markets, or Financial Services environments.

Key Responsibilities

• Lead architecture and solution design for real-time and batch data platforms
• Design and implement CDC-based ingestion solutions using AWS DMS, Kafka/MSK, Kafka Connect, and Debezium
• Build scalable streaming and batch pipelines using AWS Glue (PySpark) and Flink
• Define and implement data quality, reconciliation, lineage, observability, and SLA frameworks
• Design Data Lakehouse solutions leveraging Apache Iceberg, S3, and DynamoDB
• Implement event-driven integration patterns and API-based data exchange capabilities
• Partner with Product Owners, Architects, and Business Stakeholders to define technical roadmaps
• Provide architecture governance, technical leadership, and mentorship across engineering teams

Required Skills

• 15+ years of overall IT experience
• 5+ years as a Data Architect, Principal Engineer, or Technical Lead
• 6+ years of hands-on AWS Data Engineering experience
• Strong expertise in Apache Kafka / AWS MSK
• Hands-on experience with AWS Glue (PySpark), Flink, and Streaming ETL
• Strong experience with AWS DMS, CDC Patterns, Kafka Connect, and Debezium
• Expertise in Event-Driven Architecture and Microservices-based integrations
• Experience with Apache Iceberg, S3, DynamoDB, and Lake Formation
• Strong understanding of Data Quality, Data Reconciliation, Data Governance, and Data Observability
• Experience with Terraform/CDK, CI/CD, and Git
• Experience designing and supporting large-scale, mission-critical data platforms

Preferred Qualifications

• Experience with PostgreSQL, Athena, Lambda, Step Functions, CloudWatch, SNS, and EventBridge

Ideal Candidate

• Architect-level ownership of enterprise data platforms
• Deep expertise in AWS Streaming Architecture and Kafka/MSK
• Strong stakeholder engagement and communication skills
• Hands-on technical leader who can drive architecture, design, and implementation
• Proven experience delivering scalable, event-driven data solutions in regulated financial environments