Lead Data Engineer (Banking)

Unison Group; Singapore; On-site; SGD 180,000 - 250,000; Full time

Job summary

Unison Group is looking for a Lead Data Engineer (Banking) to design and deliver large-scale data pipelines within financial institutions. You will own end-to-end lifecycle, from data modeling to ETL/ELT, ensuring accuracy, performance, and governance across banking domains.

You will lead a team of engineers, coordinate with architects and analysts, and drive data quality, SLA adherence, and scalable solutions across Teradata, Spark, and cloud platforms.

Qualifications

• Lead-level experience delivering data pipelines inside banks.
• Strong knowledge of customer, account, transaction, payments and AML data.
• Experience working within bank release, scheduling and change controls.

Responsibilities

• Production delivery of data pipelines inside banks.
• Working with customer, account, transaction, payments and AML data.
• Collaborate with release, scheduling and change control processes.

Skills

Leadership

Data pipeline design

Banking domain knowledge

Tools

Teradata SQL

BTEQ

TPT

FastLoad/MultiLoad

Spark

PySpark/Scala

Hive

Impala

HBase

Pig

Hue

Iceberg

Trino

Python

R

Kafka

Spark Streaming

Informatica

Talend

Denodo

Snowflake

NoSQL

Airflow

Control-M

Autosys

Git

CI/CD

GitOps

Kubernetes

Delta Lake

Unity Catalog

Job description

Role: Lead Data Engineer (Banking)

Must-have skills

Banking and domain

• Production delivery of data pipelines inside banks.
• Customer, account, transaction, payments and AML data.
• Working within bank release, scheduling and change controls.

Core data engineering

• Teradata SQL, BTEQ, TPT and FastLoad/MultiLoad; query tuning.
• Spark (PySpark/Scala), Hive, Impala, HBase, Pig and Hue; Apache Iceberg and Trino; Python and R.
• Historical data processing: snapshots, SCD Type 2 and multi-grain backfills with control totals and validation reports.
• ETL/ELT development, CDC, metadata-driven automation frameworks and parameter-driven SQL generation.
• Reconciliation, data quality and SLA monitoring.
• Performance at scale: tables of 1 billion+ rows and multi-year history.

Experience:

• Lead: 12+ years, including 6+ in banking.
• Senior: 8+ years, including 4+ in banking

Banking and domain

• Production delivery of data pipelines inside banks.
• Customer, account, transaction, payments and AML data.
• Working within bank release, scheduling and change controls.

Core data engineering

• Teradata SQL, BTEQ, TPT and FastLoad/MultiLoad; query tuning.
• Spark (PySpark/Scala), Hive, Impala, HBase, Pig and Hue; Apache Iceberg and Trino; Python and R.
• Historical data processing: snapshots, SCD Type 2 and multi-grain backfills with control totals and validation reports.
• ETL/ELT development, CDC, metadata-driven automation frameworks and parameter-driven SQL generation.
• Reconciliation, data quality and SLA monitoring.
• Performance at scale: tables of 1 billion+ rows and multi-year history.

Integration and platforms

• Kafka, Spark Streaming, Informatica (PowerCenter, IDMC, IDL) and Talend; REST API development.
• Denodo, Snowflake and NoSQL databases.
• Airflow, Control-M or Autosys; Git, CI/CD, GitOps and Kubernetes.

Delivery and communication (Lead)

• Framework design, code standards, code reviews and estimation.
• Guiding a team of engineers and working with architects and analysts.

Good-to-have skills

• Databricks: Delta Lake, Unity Catalog and Workflows.
• Data services on Azure, Google Cloud, Huawei Cloud or Alibaba Cloud.
• Data modelling for Qlik Sense or Power BI.

Certifications (preferred): Teradata Vantage; Cloudera Data Engineer; Databricks Data Engineer Associate or Professional