Senior Data Platform Architect – Enterprise Data Lake & Hadoop

REGTECH INSIGHT PTE. LTD.; Singapore; Vor Ort; SGD 120.000 - 180.000; Vollzeit

Zusammenfassung

REGTECH INSIGHT PTE. LTD. in Singapore seeks an experienced Data Engineer to design, develop, and maintain scalable data pipelines within an Enterprise Data Lake, leveraging Cloudera CDP, Hadoop, Spark, Hive, Java, Python, and SQL.

The role requires strong stakeholder management, project delivery across BAU and multi-project portfolios, with Banking and Financial Services experience preferred.

Qualifikationen

• Experience designing and delivering large data platforms.
• Strong data modeling and transformation skills required.
• Ability to manage multiple projects and BAU portfolios.

Aufgaben

• Design, develop and maintain scalable data pipelines in Enterprise Data Lake.
• Create high-performance batch and near real-time ingestion frameworks.
• Develop transformations using Spark, HiveQL, SQL and Java-based processing.
• Implement ingestion patterns for structured, semi-structured, and unstructured data.
• Build and maintain batch and real-time data integration solutions.
• Define source-to-target mappings and ingestion specs.
• Deploy, troubleshoot, and optimize Hadoop-based apps.
• Collaborate with platform teams for cluster utilization and workload mgmt.
• Provide L3 production support and incident resolution.
• Monitor pipelines, cluster health and performance.

Kenntnisse

Data pipelines

Hadoop

Cloudera

Spark

Java

Python

SQL

Unix scripting

Data governance

Tools

Git

Jenkins

Azure DevOps

Jobbeschreibung

REGTECH INSIGHT PTE. LTD. in Singapore seeks an experienced Data Engineer to design, develop, and maintain scalable data pipelines within an Enterprise Data Lake, leveraging Cloudera CDP, Hadoop, Spark, Hive, Java, Python, and SQL.

The role requires strong stakeholder management, project delivery across BAU and multi-project portfolios, with Banking and Financial Services experience preferred.