Senior Data Platform Architect - Hadoop/Cloudera & Data Lake

Riskdata Consulting; Singapore; In loco; SGD 120.000 - 180.000; Tempo pieno

Descrizione del lavoro

Riskdata Consulting is seeking a senior data engineer to design, develop, and operate enterprise data pipelines within a Banking/Financial Services context. You will work across Data Lake, Data Warehouse, and big data initiatives, leveraging Hadoop, Cloudera CDP, Spark, Hive, Kafka, and Java/Python to deliver scalable solutions.

This role requires strong stakeholder management and the ability to manage multiple deliveries and BAU portfolios while ensuring governance and quality across data

Competenze

• 10+ years of experience in data engineering or related roles.
• 5+ years delivering Enterprise Data Lake, Data Warehouse or Big Data initiatives.
• Proven experience in Hadoop/Cloudera environments.
• Experience managing multiple concurrent project deliveries and BAU portfolios.
• Banking and Financial Services experience preferred.

Mansioni

• Design and maintain scalable data pipelines on the Data Lake platform.
• Develop high-performance batch and near real-time ingestion frameworks.
• Implement data transformations using Spark, HiveQL, SQL, and Java.
• Ensure data ingestion supports structured, semi-structured, and unstructured data.
• Provide L3 production support and incident management for Data Lake apps.

Conoscenze

Stakeholder management

Project delivery

Data modeling

Communication

Team leadership

Strumenti

Hadoop

Cloudera CDP

Hive

Spark

Kafka

YARN

Oozie

HDFS

Java

Python

SQL

Unix/Linux scripting

Shell scripting

ETL/ELT

Descrizione del lavoro

Riskdata Consulting is seeking a senior data engineer to design, develop, and operate enterprise data pipelines within a Banking/Financial Services context. You will work across Data Lake, Data Warehouse, and big data initiatives, leveraging Hadoop, Cloudera CDP, Spark, Hive, Kafka, and Java/Python to deliver scalable solutions.

This role requires strong stakeholder management and the ability to manage multiple deliveries and BAU portfolios while ensuring governance and quality across data