Senior Assoc, Application Developer, Middle Office Technology - Finance Platform, Group Technology

DBS Bank Ltd; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

DBS Bank Ltd in Singapore is seeking a seasoned Technology professional to design, build, and optimize data pipelines within the Hadoop ecosystem. You will tune Spark/SQL ETL performance, automate batch workflows, and manage storage with HDFS and Parquet.

Proficiency in Shell, Python, and Scala, plus AWS S3 experience, will enable you to drive reliable data processing across the bank’s enterprise environment. Strong Linux/Unix skills are essential.

Qualifications

• Proven experience in enterprise-scale application development.
• Strong Hadoop, HDFS, Hive and Impala expertise.
• Proficiency with Spark (Scala/Java) and SQL.
• Experience with Parquet and data formats.
• ETL performance tuning experience.
• Strong Linux/Unix command-line skills.
• Scripting in Shell, Python and Scala.
• Experience with batch automation using REST APIs.

Responsibilities

• Design, develop, and maintain scalable data pipelines in Hadoop ecosystem.
• Tune SQL and Spark ETL performance to reduce latency.
• Automate batch processes using Shell scripts and REST APIs.
• Manage data storage, ingestion, and retrieval with HDFS and Parquet.
• Develop scripts in Shell, Python, and Scala for workflows and integrations.
• Leverage AWS S3 for cloud-based data management and integration.
• Troubleshoot complex issues in Linux/Unix environments.

Skills

Hadoop

HDFS

Hive

Impala

Spark (Scala/Java)

SQL

Linux/Unix

Shell scripting

Python

Scala

REST APIs

AWS S3

Tools

Parquet

REST APIs

AWS

Job description

Business Function

Group Technology enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group Technology, we manage the majority of the Bank’s operational processes and inspire to delight our business partners through our multiple banking delivery channels.

Responsibilities

• Design, develop, and maintain scalable data pipelines and applications within the Hadoop ecosystem.
• Perform performance tuning of SQL and Spark ETL processing to optimize system efficiency and reduce latency.
• Implement batch automation using Shell scripts and REST APIs, including job triggering and result parsing.
• Manage data storage, ingestion, and retrieval processes using HDFS and Parquet
• Develop robust scripts using Shell, Python, and Scala to automate operational workflows and system integrations.
• Utilize AWS products, such as S3 Storage, for cloud-based data management and integration.
• Troubleshoot, debug, and resolve complex technical issues within Linux/Unix environments.

Requirements

• Proven experience in application development within a large-scale enterprise technology environment.
• Strong technical expertise in Hadoop, HDFS, Hive, and Impala.
• Proficiency in Spark (Scala/Java) and SQL.
• Hands-on experience with data serialization and storage formats including Parquet
• Demonstrated ability in the performance tuning of SQL and Spark ETL processing.
• Strong command of Linux/Unix systems and command-line tools.
• Expertise in scripting using Shell, Python, and Scala.
• Experience in batch automation using Shell scripts and REST APIs, including triggering and result parsing.
• Familiarity with cloud technologies, specifically AWS products such as S3 Storage.
• Strong problem-solving skills and a can-do attitude, with the ability to develop solutions.

Location:

DBS Asia Hub

Job:

Technology

Schedule:

Regular

Employee Status:

Full time