Senior Databricks Data Engineer - Lakehouse & Governance

Esync Software Services; Kuala Lumpur; On-site; MYR 180,000 - 260,000; Full time

Job summary

Jora Malaysia is seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and data products using Databricks and PySpark. You will shape enterprise DW/Lakehouse solutions supporting analytics, AI/ML use cases, and ensure data quality, security, and performance.

The role requires 4+ years in Databricks within enterprise contexts, strong governance experience with Unity Catalog, and expertise in dimensional modeling and ETL/ELT design.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.
• 5–8 years of experience in Data Engineering, Data Warehousing, or Big Data technologies.
• Minimum 4+ years of hands-on Databricks experience in enterprise environments.
• Experience designing and implementing enterprise Data Warehouse solutions and modern Lakehouse architectures.

Responsibilities

• Design, develop, and maintain scalable data pipelines and data products using Databricks and PySpark.
• Build and optimize ETL/ELT solutions supporting batch and near real-time data processing.
• Design, develop, and maintain enterprise Data Warehouse and Lakehouse solutions that support reporting, analytics, and AI/ML use cases.
• Develop and maintain enterprise data models using Delta Lake and Delta Tables.
• Design and implement dimensional data models, including Fact and Dimension tables, Star Schema, Snowflake Schema, and SCD.
• Ensure data quality, reliability, scalability, and performance across the data platform.
• Implement best practices for code management, testing, deployment, and operational monitoring.
• Design and maintain governance frameworks utilizing Unity Catalog, RBAC, ABAC, and data lineage.

Skills

PySpark

Databricks

Delta Lake

Unity Catalog

RBAC

ABAC

GitHub

CI/CD

SQL

Cloud platforms

Education

Bachelor's degree in CS/IT/Engineering

Tools

Power BI

Tableau

GitHub Actions

Job description

Jora Malaysia is seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and data products using Databricks and PySpark. You will shape enterprise DW/Lakehouse solutions supporting analytics, AI/ML use cases, and ensure data quality, security, and performance.

The role requires 4+ years in Databricks within enterprise contexts, strong governance experience with Unity Catalog, and expertise in dimensional modeling and ETL/ELT design.