Senior Real-Time Data & Streaming Architect

Ports North; Dublin; On-site; EUR 120,000 - 160,000; Full time

Job summary

Ports North is seeking an experienced Solution Architect to lead end-to-end architecture for complex, distributed data, streaming and integration solutions in a large-scale enterprise environment.

You will shape architectural standards, collaborate with engineering teams, and ensure solutions are scalable, secure, resilient and production-ready. Significant leadership across multiple workstreams is expected.

Qualifications

• 10+ years' IT experience required.
• 5+ years in solution/technical architecture or senior design leadership.
• Experience with streaming/real-time data apps using Kafka.
• Understanding Kafka consumer groups, offsets, retries, dead-letter handling, ordering.
• Experience with Cloudera CDH/CDP.
• Designing data ingestion, transformation, storage and consumption.
• Strong knowledge of batch and real-time processing architectures.
• Experience in complex enterprise environments with multiple systems.
• Non-functional requirements including performance, scalability, resilience, security, observability and operations.
• Leading architecture across programmes/workstreams.

Responsibilities

• Own end-to-end solution architecture for large-scale data, streaming and integration.
• Provide architectural leadership across data, integration and streaming platforms.
• Design scalable solutions across Cloudera, Kafka, APIs and cloud platforms.
• Provide architectural oversight during delivery and ensure alignment with designs.
• Review designs and challenge implementation approaches.
• Identify risks, dependencies, assumptions and trade-offs.
• Work with engineering teams to ensure scalable, secure and production-ready solutions.
• Represent designs at architecture governance and review forums.
• Develop and promote architectural patterns, engineering standards and best practices.
• Provide technical leadership across multiple workstreams and mentor senior resources.

Skills

IT experience

Solution architecture

Kafka / streaming

Cloudera CDH/CDP

Data ingestion

Batch & real-time processing

Java / Spring Boot

NoSQL

AWS / Cloud

CI/CD

Observability

Architecture governance

Tools

Spark

Flink

Hive

Impala

Job description

Ports North is seeking an experienced Solution Architect to lead end-to-end architecture for complex, distributed data, streaming and integration solutions in a large-scale enterprise environment.

You will shape architectural standards, collaborate with engineering teams, and ensure solutions are scalable, secure, resilient and production-ready. Significant leadership across multiple workstreams is expected.