Senior Data Engineer

CADENZA SOLUTIONS PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

CADENZA SOLUTIONS PTE. LTD. in Singapore seeks a Senior Data Engineer to design scalable data pipelines and enable analytics workloads using Databricks on AWS, PySpark, and Python.

You will transform and cleanse data from diverse sources, collaborate with analytics teams, and ensure data quality, governance, and cost-efficient ETL automation across projects. The ideal candidate will refactor Informatica DEI workflows into Databricks-based solutions and optimize ETL performance while

Qualifications

• Minimum 8 years of experience in data engineering.
• Strong proficiency with Databricks on AWS, PySpark and Python.
• Experience in ETL development, data transformations, data quality frameworks/standards, and pipeline automation.

Responsibilities

• Design and implement scalable data pipelines on Databricks AWS and PySpark.
• Ingest, transform, cleanse, and validate data from multiple sources.
• Collaborate with analytics and data science teams for reporting and modeling.
• Translate Informatica DEI workflows into Databricks implementations.
• Automate ETL workflows for performance and cost efficiency.
• Ensure data quality, lineage, and governance across solutions.

Skills

Data Engineering

Data Science

ETL

Informatica

Java

Tools

Databricks on AWS

PySpark

Python

Informatica DEI

Job description

Role Overview :

We are seeking a highly skilled Senior Data Engineer with a strong background in building scalable data pipelines, performing complex data transformations, and enabling analytics workloads. The ideal candidate should have hands-on experience with Databricks on AWS, PySpark, and Python, with a working understanding of ETL orchestration and automation. Familiarity with Informatica DEI is a plus, as the role may involve refactoring existing Informatica workflows into PySpark.

Key Responsibilities:

• Design and implement robust, scalable data pipelines using Databricks on AWS and PySpark
• Perform data ingestion, transformation, cleansing, and validation from various sources
• Collaborate with analytics and data science teams to deliver high-quality data for reporting and modeling
• Understand and translate Informatica DEI workflows into Databricks-based implementations (if applicable)
• Optimize and automate ETL workflows for performance and cost-efficiency
• Ensure data quality, lineage, and governance are upheld in all solutions

Required Skills & Experience:

• Minimum 8 years of experience in Data Engineering
• Strong proficiency in Databricks on AWS, PySpark, and Python
• Solid experience in ETL development, data transformations, cleaning, data quality frameworks/standards, and pipeline automation
• Understanding of data quality principles and performance tuning techniques - Familiarity with Informatica DEI is a nice to have
• Excellent communication skills in client-facing environments

2. SKILLS

• Data Engineering
• Data Science
• ETL
• Informatica
• Java