Lead Data Engineer - Databricks Gold Layer & Data Marts

ELLIOTT MOSS CONSULTING PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

ELLIOTT MOSS CONSULTING PTE. LTD.

in Singapore seeks an experienced Data Engineer to lead the Gold layer Data Mart design on the Unified Data Platform (Databricks), building scalable pipelines for Power BI reporting and acting as bridge between Singapore design team and offshore engineers. You will own ETL/ELT development, leverage Delta Lake, Delta Live Tables, Unity Catalog, and maintain data quality, governance, and performance.

Qualifications

• 5+ years of data engineering with ETL/ELT focus.
• Experience with Databricks platform and Delta Lake.
• Proficiency in PySpark and Databricks SQL for large-scale transformations.
• Strong understanding of star schema, SCD Type 2, and dimensional modelling.
• Experience implementing data quality frameworks and SIT/UAT support.

Responsibilities

• Design Gold layer Data Mart tables and views in Databricks per STTM.
• Implement Silver-to-Gold transformations using DLT, Databricks Workflows, and PySpark.
• Create Delta table DDL in Unity Catalog with schema and comments.
• Apply SCD Type 2 and aggregation logic per grain specs.
• Configure partitioning, Z-Order, and clustering for performance.
• Develop data quality checks and Delta Live Tables DQ rules.
• Schedule and manage Databricks Workflow DAGs for pipelines.

Skills

Databricks

PySpark

Delta Lake

Delta Live Tables

Databricks SQL

Unity Catalog

ETL/ELT

Dimensional modelling

SCD Type 2

Data quality frameworks

Git

CI/CD for Databricks

Power BI integration

Tools

Databricks Workflows

Delta Live Tables

Databricks Unity Catalog access control

Delta Lake

Job description

ELLIOTT MOSS CONSULTING PTE. LTD.

in Singapore seeks an experienced Data Engineer to lead the Gold layer Data Mart design on the Unified Data Platform (Databricks), building scalable pipelines for Power BI reporting and acting as bridge between Singapore design team and offshore engineers. You will own ETL/ELT development, leverage Delta Lake, Delta Live Tables, Unity Catalog, and maintain data quality, governance, and performance.