Data Lake Platform Engineer (Hadoop/ETL)

UNISONEDGE CONSULTING PTE. LTD.; Singapore; Presencial; SGD 90.000 - 130.000; Jornada completa

Descripción de la vacante

UNISONEDGE CONSULTING PTE. LTD. seeks a Data Engineer to build scalable transformation frameworks across Hadoop platforms, delivering robust data pipelines, ingestion frameworks, and automation for enterprise data sources.

You’ll support data warehouse, analytics, and downstream consumption across banking domains. You'll work with Cloudera CDP, Hadoop, Spark, Hive, Kafka, and related technologies, ensuring data quality, performance optimization, and reliable data integration.

Formación

• Design and maintain scalable data pipelines in the Enterprise Data Lake.
• Develop high-performance batch and near real-time ingestion frameworks.
• Implement data ingestion patterns for structured, semi-structured, and unstructured data.
• Ensure governance and data quality across the data lake/onboarding standards.

Responsabilidades

• Design and develop data pipelines within Cloudera CDP/Hadoop ecosystem.
• Optimize performance, troubleshoot, and tune Hadoop-based apps.
• Integrate data engineering solutions into CI/CD pipelines.
• Provide L3 production support and incident resolution for data pipelines.

Conocimientos

Hadoop

Spark

Hive

Java

Python

SQL

Unix/Linux scripting

Shell scripting

ETL/ELT

Data modelling

Data Warehousing

Data Lake

Herramientas

Cloudera CDP

Kafka

Oozie

Git

Jenkins

Azure DevOps

Descripción del empleo

UNISONEDGE CONSULTING PTE. LTD. seeks a Data Engineer to build scalable transformation frameworks across Hadoop platforms, delivering robust data pipelines, ingestion frameworks, and automation for enterprise data sources.

You’ll support data warehouse, analytics, and downstream consumption across banking domains. You'll work with Cloudera CDP, Hadoop, Spark, Hive, Kafka, and related technologies, ensuring data quality, performance optimization, and reliable data integration.