Senior Data Engineer -Azure / Databricks Platform (Corporate Banking)

Avensys Consulting Pte Ltd; Singapore; On-site; SGD 150,000 - 190,000; Full time

Job summary

Avensys Consulting Pte Ltd in Singapore invites a senior Data SME to lead data engineering efforts on Azure and Databricks within a Corporate Banking context. You will own data solutions end-to-end on a live data platform, focusing on data mapping, pipeline design, and DW concepts.

The role requires deep hands-on SQL and Python, SDLC mastery, and the ability to deliver high-quality data products in a regulated banking environment.

Qualifications

• At least 10 years of experience in the data space with exposure to Corporate Banking.
• Strong hands-on SQL and Python skills and data mapping expertise.
• Deep knowledge of Azure and Databricks platform, including pipeline development and performance tuning.
• Understanding of data warehouse concepts (dimensional modeling, ETL/ELT) and SDLC.
• Experience with data quality, requirements analysis, design, build, test, and deployment.

Responsibilities

• Lead requirement analysis, design, build, and testing for data workstreams.
• Own data warehouse design and data mapping across platform components.
• Design, build, and optimize data pipelines on Azure and Databricks.
• Write SQL and Python scripts for data validation and transformation.
• Coordinate integration using FTP/SFTP, MQ, and APIs between systems.
• Provide banking domain context for Trade, Lending, or Payments data where relevant.

Skills

Data mapping

Databricks

Azure

SQL

Python

SDLC

Data warehouse concepts

Performance tuning

APIs/MQ/FTP

Tools

Databricks

Azure

FTP/SFTP

MQ

APIs

Job description

Avensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation and managed services. Given our decade of success, we have evolved to become one of the top trusted providers in Singapore and service a client base across banking and financial services, insurance, information technology, healthcare, retail and supply chain.

We are looking for a senior Data SME to support a data engineering initiative built on Azure and Databricks within a Corporate Banking context. The ideal candidate brings deep, hands-on technical experience in data mapping and the Databricks platform, strong SDLC and data warehouse fundamentals, and is comfortable owning data solutions end-to-end on a live banking data platform. Trade, Lending, or Payments domain exposure is a strong plus

Requirements :

• At least 10 years of experience in the data space, with exposure to Corporate Banking.
• Technically strong in data mapping (source-to-target) and the Databricks platform - pipeline development, job/cluster management, and performance tuning.
• Strong experience across SDLC phases: requirements, design, build, test, and deployment.
• Strong understanding of data warehouse concepts (e.g., dimensional modeling, ETL/ELT).
• Strong working knowledge of Azure and Databricks.
• Strong hands-on SQL and Python skills.
• Working knowledge of integration methods: file transfer protocols (FTP/SFTP), MQ, and APIs.

Key Responsibilities:

• Apply SDLC concepts to lead requirement analysis, design, build, and testing activities for data workstreams.
• Own data warehouse design and data mapping activities, including data modeling and data quality standards.
• Design, build, and optimize data pipelines on Azure and Databricks, including performance tuning and troubleshooting.
• Design and own source-to-target data mapping specifications across platform components, ensuring traceability and sign-off.
• Write and troubleshoot advanced SQL and Python scripts for data validation, transformation, and analysis.
• Drive integration design and delivery involving file transfer protocols (FTP/SFTP), MQ, and APIs between source and target systems.
• Bring Corporate Banking context to data solutioning, flagging domain-specific considerations (e.g., Trade, Lending, or Payments data) where relevant.

WHAT’S ON OFFER

You will be remunerated with an excellent base salary and entitled to attractive company benefits. Additionally, you will get the opportunity to enjoy a fun and collaborative work environment, alongside a strong career progression.

Your interest will be treated with strict confidentiality.

CONSULTANT DETAILS:

EA Licence 12C5759

Privacy Statement: Data collected will be used for recruitment purposes only. Personal data provided will be used strictly in accordance with the relevant data protection law and Avensys' privacy policy