Senior Data Engineer | Scalable Pipelines on Databricks AWS

CADENZA SOLUTIONS PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

CADENZA SOLUTIONS PTE. LTD. in Singapore seeks a Senior Data Engineer to design scalable data pipelines and enable analytics workloads using Databricks on AWS, PySpark, and Python.

You will transform and cleanse data from diverse sources, collaborate with analytics teams, and ensure data quality, governance, and cost-efficient ETL automation across projects. The ideal candidate will refactor Informatica DEI workflows into Databricks-based solutions and optimize ETL performance while

Qualifications

• Minimum 8 years of experience in data engineering.
• Strong proficiency with Databricks on AWS, PySpark and Python.
• Experience in ETL development, data transformations, data quality frameworks/standards, and pipeline automation.

Responsibilities

• Design and implement scalable data pipelines on Databricks AWS and PySpark.
• Ingest, transform, cleanse, and validate data from multiple sources.
• Collaborate with analytics and data science teams for reporting and modeling.
• Translate Informatica DEI workflows into Databricks implementations.
• Automate ETL workflows for performance and cost efficiency.
• Ensure data quality, lineage, and governance across solutions.

Skills

Data Engineering

Data Science

ETL

Informatica

Java

Tools

Databricks on AWS

PySpark

Python

Informatica DEI

Job description

CADENZA SOLUTIONS PTE. LTD. in Singapore seeks a Senior Data Engineer to design scalable data pipelines and enable analytics workloads using Databricks on AWS, PySpark, and Python.

You will transform and cleanse data from diverse sources, collaborate with analytics teams, and ensure data quality, governance, and cost-efficient ETL automation across projects. The ideal candidate will refactor Informatica DEI workflows into Databricks-based solutions and optimize ETL performance while