Senior Data Engineer - Azure & Databricks (Banking)

avensys consulting pte. ltd.; Singapore; On-site; SGD 150,000 - 210,000; Full time

Job summary

Avensys Consulting Pte. Ltd. is seeking a Senior Data SME to lead data engineering initiatives on Azure and Databricks within a Corporate Banking context. You will own data solutions end-to-end on a live banking platform, with Trade, Lending, or Payments domain exposure as a strong plus.

The role demands 10+ years in data with deep Databricks and SQL/Python expertise, a strong SDLC background, and proficiency in data warehousing concepts and integration methods.

Qualifications

• 10+ years of experience in data with exposure to Corporate Banking.
• Deep experience in data mapping, Databricks platform, pipeline development and performance tuning.
• Strong SDLC experience across requirements, design, build, test and deployment.
• Solid understanding of data warehouse concepts (dimensional modeling, ETL/ELT).
• Proficient with Azure and Databricks.
• Strong SQL and Python hands-on skills.
• Experience with integration methods: FTP/SFTP, MQ, APIs.

Responsibilities

• Lead requirement analysis, design, build and testing for data workstreams.
• Own data warehouse design and data mapping, ensuring quality and sign-off.
• Design, build and optimize pipelines on Azure and Databricks, with performance tuning.
• Define source-to-target data mappings with traceability across components.
• Write and troubleshoot SQL and Python scripts for validation and transformation.
• Drive integration design using FTP/SFTP, MQ and APIs between systems.
• Apply Corporate Banking context to data solutions, flagging domain considerations.

Skills

Databricks

Azure

SQL

Python

Data mapping

Data warehousing

SDLC

ETL/ELT

APIs

Banking domain

Tools

Azure Databricks

FTP/SFTP

MQ

APIs

Job description

Avensys Consulting Pte. Ltd. is seeking a Senior Data SME to lead data engineering initiatives on Azure and Databricks within a Corporate Banking context. You will own data solutions end-to-end on a live banking platform, with Trade, Lending, or Payments domain exposure as a strong plus.

The role demands 10+ years in data with deep Databricks and SQL/Python expertise, a strong SDLC background, and proficiency in data warehousing concepts and integration methods.