Big Data Applications Developer — Hadoop/Data Lake

UARROW PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

UARROW PTE. LTD. in Singapore is hiring a Data Engineer to design, build, and maintain scalable data pipelines across the Enterprise Data Lake using Hadoop, Spark, Hive, and related technologies.

You will integrate diverse data sources, optimize batch and streaming processing, and collaborate with platform and analytics teams. The role requires strong Java and Python, SQL expertise, and experience with CI/CD tooling.

Qualifications

• Strong Java and Python development experience.
• Extensive SQL development and data modelling skills.
• Hands-on with Hadoop ecosystem (HDFS, Hive, Spark).
• Experience in building scalable data pipelines and ETL/ELT processes.
• Familiarity with data governance, QA, and production support.
• Proficient in CI/CD and automation tooling.

Responsibilities

• Design, develop, and maintain scalable data pipelines in the Data Lake.
• Build high-performance batch and near real-time ingestion frameworks.
• Implement data transformation logic using Spark, HiveQL, SQL, and Java-based processing.
• Ensure data quality, governance, and onboarding standards.

Skills

Java

Python

SQL

Unix scripting

Shell scripting

ETL/ELT

Data modelling

Data Warehousing

Hadoop

Spark

Hive

Impala

Kafka

YARN

Oozie

CI/CD

Tools

Git

Jenkins

Azure DevOps

Job description

UARROW PTE. LTD. in Singapore is hiring a Data Engineer to design, build, and maintain scalable data pipelines across the Enterprise Data Lake using Hadoop, Spark, Hive, and related technologies.

You will integrate diverse data sources, optimize batch and streaming processing, and collaborate with platform and analytics teams. The role requires strong Java and Python, SQL expertise, and experience with CI/CD tooling.