Senior Data Platform & Streaming Architect (Kafka/Cloudera)

Softest Consulting Services Limited; Dublin; On-site; EUR 120,000 - 180,000; Full time

Job summary

Softest Consulting Services Limited is seeking an experienced Solution Architect to own end-to-end architecture for large-scale data, streaming, and integration platforms in a Dublin-based environment.

The role requires senior leadership across multiple workstreams, strong governance experience, and hands-on guidance on Cloudera CDP, Kafka, and cloud-native data services on AWS. Collaboration with governance boards is essential.

Qualifications

• 10+ years’ overall IT experience with data platform, integration or distributed systems delivery.

Responsibilities

• Own the end-to-end solution architecture for large-scale distributed data, streaming and data integration solutions.
• Act as the lead architect for Data Solutions distributed data, integration and streaming platforms across initiatives.
• Accountable for solution architecture across the Enterprise Data Lake, Operational Datastore and CDP environment on AWS.
• Design scalable distributed data and streaming solutions across Cloudera, Kafka, API and cloud platforms.
• Provide architectural oversight across solution delivery ensuring consistency and alignment with designs.
• Work with engineering teams to ensure solutions are deliverable, secure, and scalable.
• Review technical designs to ensure alignment with approved architectures.
• Identify risks, dependencies, non-functional requirements and trade-offs.
• Support delivery planning by breaking solutions into iterative increments.
• Represent designs at architecture review boards and governance forums.
• Develop architectural patterns and engineering standards across the data platform.

Skills

Distributed data platforms

Data lake architecture

Kafka

Spark/Flink

API and REST

NoSQL (HBase/Cassandra)

AWS Cloud

DevOps/CI–CD

Data governance

Architecture leadership

Tools

Cloudera CDH/CDP

Java

Spring Boot

REST services

HBase

Cassandra

Hive/Impala

AWS

Spark

Flink

Job description

Softest Consulting Services Limited is seeking an experienced Solution Architect to own end-to-end architecture for large-scale data, streaming, and integration platforms in a Dublin-based environment.

The role requires senior leadership across multiple workstreams, strong governance experience, and hands-on guidance on Cloudera CDP, Kafka, and cloud-native data services on AWS. Collaboration with governance boards is essential.