Senior Data Engineer Banking/Financial

regtech insight pte. ltd.; Singapore; On-site; SGD 180,000 - 240,000; Full time

Job summary

regtech insight pte. ltd. seeks a Senior Data Engineer to lead design and implementation of large-scale data engineering solutions in banking environments.

You will drive platform modernization, migration, and regulatory initiatives while guiding technical teams and aligning with stakeholders to ensure robust data delivery. You will architect and optimize end-to-end data pipelines, oversee ETL platforms, and deliver AML/Fraud/MAS compliant data solutions.

Qualifications

• Proven leadership of large data engineering teams.
• Experience with Teradata-to-Hadoop/Data Lake migration.
• Experience delivering regulatory or risk-data initiatives (AML, MAS, BCBS239).

Responsibilities

• Design and implement large-scale data pipelines and ETL frameworks.
• Develop data integration using PySpark, Python, SQL; Hadoop/HDFS, Spark, Hive, Teradata.
• Lead migration to Hadoop/Data Lake and modernize legacy platforms.
• Oversee ETL platforms like Talend, DataStage, or Informatica, including tuning.
• Apply data modeling, profiling, quality assurance, lineage, and transformations on large datasets.
• Provide technical leadership through reviews, governance and production support.
• Design data architectures, CI/CD pipelines and orchestration with Autosys, Control-M, Jenkins, Git.
• Oversee data migration, job optimization, capacity planning, production/BAU in high-volume banking environments.
• Deliver regulatory and risk-data initiatives aligned with AML, Fraud, MAS, BCBS239, data quality, lineage.
• Manage stakeholder relationships with banking tech teams and senior clients.

Skills

Python

PySpark

SQL

Hadoop HDFS

Spark

Hive

Teradata

Tools

Talend

DataStage

Informatica

Job description

Job Summary

Lead the design and implementation of large-scale data engineering solutions within banking environments. Drive data platform modernization, migration, and regulatory initiatives while managing technical teams and collaborating with stakeholders to ensure robust, high-quality data delivery.

Responsibilities

• Design and implement large-scale data pipelines, ETL frameworks, and batch processing solutions to support enterprise data platforms.
• Develop and optimize data integration processes using Python, PySpark, SQL, Hadoop HDFS, Spark, Hive, and Teradata technologies.
• Lead Teradata-to-Hadoop/Data Lake migration projects, legacy platform modernization, technology refresh, and application decommissioning efforts.
• Manage and optimize enterprise ETL platforms such as Talend, DataStage, or Informatica, including migration and performance tuning.
• Apply data modeling, profiling, quality assurance, lineage tracking, and transformation techniques on large structured and unstructured datasets.
• Provide technical leadership to large data engineering teams through solution design, code and design reviews, troubleshooting, delivery governance, and production support.
• Design data architecture frameworks, CI/CD pipelines, and orchestration workflows using Autosys, Control-M, Jenkins, and Git.
• Oversee enterprise data migration, job optimization, capacity planning, and production/BAU support in high-volume banking environments.
• Deliver regulatory and risk-data initiatives aligned with AML, Fraud, MAS regulations, BCBS239, data quality, and critical data element lineage requirements.
• Manage stakeholder relationships with banking technology teams, business analysts, infrastructure, data management, and senior clients to ensure successful technical solution delivery.

Required competencies and certifications

• Hands-on expertise in Python, PySpark, SQL, Hadoop HDFS, Spark, Hive, and Teradata technologies.
• Experience with enterprise ETL platforms such as Talend, DataStage, or Informatica.
• Proven technical leadership of large data engineering teams.
• Experience in Teradata-to-Hadoop/Data Lake migration and legacy platform modernization.
• Experience delivering regulatory or risk-data initiatives including AML, Fraud, MAS regulatory requirements, BCBS239, and data quality.

Preferred competencies and qualifications

• Experience within Banking/Financial Services, especially Retail Banking, Cards, AML, Fraud, Regulatory Reporting, or Data Warehouse environments.
• Strong stakeholder management skills with cross-functional teams and senior client stakeholders.
• Experience designing CI/CD pipelines and orchestration using Autosys, Control-M, Jenkins, and Git.
• Experience with performance tuning, job optimization, capacity planning, and production/BAU support in high-volume banking environments.