Senior Data Pipeline Architect & Tech Lead

UNISONEDGE CONSULTING PTE. LTD.; Singapore; On-site; SGD 70,000 - 110,000; Full time

Job summary

UNISONEDGE CONSULTING PTE. LTD. is seeking a data engineer to design, develop, and support enterprise-scale data engineering solutions across banking and financial services. You will focus on data pipelines, ETL processing, big data platforms, data migration, data quality, and optimization.

You will work with Python, PySpark, SQL, Hive, and Spark on Hadoop ecosystems, implement CI/CD for data pipelines, and collaborate with business and infrastructure teams to deliver scalable data solutions.

Qualifications

• Bachelor's degree in Computer Science, IT, Data Engineering or a related discipline.
• Strong hands-on experience in data engineering, ETL, data warehousing, and Big Data technologies.
• Proficiency in Python, PySpark, SQL, and Hive/HQL.
• Experience with Hadoop, Spark, and enterprise data platforms.
• Experience with Talend, DataStage and/or Informatica.
• Experience with Teradata, Oracle, or SQL Server.
• Unix/Linux and shell scripting.
• CI/CD tooling such as Git and Jenkins.
• Strong data modelling, data quality, and data pipeline optimisation.
• Banking or financial services experience is advantageous.

Responsibilities

• Design, develop, and optimize scalable data pipelines and ETL processes.
• Develop and maintain data processing solutions using Python, PySpark, SQL, Hive, and Spark.
• Work with Big Data platforms including Hadoop HDFS, Hive, and cloud/object storage environments.
• Perform data extraction, transformation, and loading from multiple source systems.
• Design and implement data migration and modernization solutions using DataStage, Talend, Informatica, and Hadoop.
• Develop and optimize batch processing and scheduling workflows using Autosys and Control-M.
• Perform data profiling and data quality checks; support data warehouse and dimensional modelling.
• Implement CI/CD processes for data pipeline deployments; collaborate with business and infrastructure teams.

Skills

Python

PySpark

SQL

Hive/HQL

ETL

Data modelling

CI/CD

Unix/Linux shell

Data warehousing

Education

Bachelor's degree in Computer Science/IT/Data Engineering

Tools

Git

Jenkins

Talend

DataStage

Informatica

Hadoop

Spark

Teradata

Oracle

SQL Server

Snowflake

Cloudera

Job description

UNISONEDGE CONSULTING PTE. LTD. is seeking a data engineer to design, develop, and support enterprise-scale data engineering solutions across banking and financial services. You will focus on data pipelines, ETL processing, big data platforms, data migration, data quality, and optimization.

You will work with Python, PySpark, SQL, Hive, and Spark on Hadoop ecosystems, implement CI/CD for data pipelines, and collaborate with business and infrastructure teams to deliver scalable data solutions.