Senior Data Platform Architect – Banking & Big Data

UARROW PTE. LTD.; Singapore; On-site; SGD 154,000 - 231,000; Full time

Job summary

UARROW PTE. LTD. seeks an experienced Data Engineer to design, develop and operate scalable data pipelines in a Data Lake environment. You will leverage Cloudera CDP, Hadoop, Spark, Hive, Java, Python and SQL to ingest and transform large enterprise data, while ensuring governance and quality across platforms.

You will own end-to-end delivery, manage multiple concurrent projects, and collaborate with stakeholders in a banking/financial services context to optimize performance and reliability.

Qualifications

• 10+ years of experience in enterprise data platforms.
• 5+ years managing Enterprise Data Lake, Data Warehouse or Big Data projects.
• Proven experience in Hadoop/Cloudera environments.
• Banking/financial services experience preferred.
• Experience managing multiple concurrent project deliveries and BAU portfolios.
• Strong stakeholder management and communications.

Responsibilities

• Design, develop, and maintain scalable data pipelines in the data lake using Cloudera CDP, Hadoop, Spark, Hive, Java, Python, and SQL.
• Develop high-performance batch and near real-time data ingestion frameworks for onboarding enterprise source systems into the Data Lake.
• Develop complex transformation logic using Spark, HiveQL, SQL, and Java-based processing frameworks.
• Design and implement data ingestion patterns for structured, semi-structured, and unstructured datasets.
• Build and maintain batch and near real-time data integration solutions.
• Implement source-to-target mappings and ingestion specifications.
• Perform deployment, troubleshooting, and performance tuning of Hadoop applications.
• Partner with platform teams to ensure optimal cluster utilization and workload management.
• Provide L3 production support; monitor pipelines and incident management.
• Data quality, governance, and compliance with standards.

Skills

Enterprise data platforms

Stakeholder management

Project delivery

SQL development

Java

Python

Data modeling

Data integration

Big data concepts

Tools

Hadoop

Cloudera CDP

Spark

Hive

Kafka

YARN

Oozie

Git

Jenkins

Azure DevOps

Unix/Linux scripting

Shell scripting

Job description

UARROW PTE. LTD. seeks an experienced Data Engineer to design, develop and operate scalable data pipelines in a Data Lake environment. You will leverage Cloudera CDP, Hadoop, Spark, Hive, Java, Python and SQL to ingest and transform large enterprise data, while ensuring governance and quality across platforms.

You will own end-to-end delivery, manage multiple concurrent projects, and collaborate with stakeholders in a banking/financial services context to optimize performance and reliability.