Databricks Data Platform Engineer: Lakehouse & Governance

Esync Software Services; Kuala Lumpur; On-site; MYR 150,000 - 230,000; Full time

Job summary

Esync Software Services in Kuala Lumpur is seeking a Senior Data Engineer to design and deliver scalable data pipelines and data products using Databricks, PySpark, Delta Lake, and Unity Catalog.

You will optimize performance, implement CI/CD with GitHub Actions, collaborate with stakeholders, and guide production support while ensuring data security and governance across cloud deployments.

Qualifications

• Bachelor's degree in CS/IT/Engineering/Data Science or related field.
• 5–8 years of experience in Data Engineering, Data Warehousing or Big Data technologies.
• 4+ years of hands-on Databricks experience in enterprise environments.
• Experience designing enterprise Data Warehouse and modern Lakehouse.
• PySpark development and optimization.
• Delta Lake and Delta Tables.
• Unity Catalog implementation and governance.
• CI/CD using GitHub Actions or equivalent.
• SQL and advanced query optimization.
• Cloud platforms (Azure, AWS, or GCP).
• Data security, governance, and compliance frameworks.

Responsibilities

• Design, develop, and maintain scalable data pipelines and data products using Databricks and PySpark.
• Build and optimize ETL/ELT solutions supporting batch and near real-time processing.
• Develop enterprise Data Warehouse and Lakehouse solutions for reporting, analytics, and AI/ML use cases.
• Implement governance via Unity Catalog, RBAC/ABAC, data lineage, and Delta Sharing.
• Perform PySpark performance tuning, query optimization, and workload management.
• Design and maintain CI/CD pipelines and integrate with GitHub Actions.
• Collaborate with stakeholders to deliver scalable data solutions and provide technical mentorship.

Skills

Databricks

PySpark

Delta Lake

Unity Catalog

RBAC/ABAC

CI/CD

SQL

Cloud platforms

Education

Bachelor's Degree in CS/IT/Engineering/Data Science

Tools

Databricks

GitHub Actions

Terraform

Power BI

Tableau

Job description

Esync Software Services in Kuala Lumpur is seeking a Senior Data Engineer to design and deliver scalable data pipelines and data products using Databricks, PySpark, Delta Lake, and Unity Catalog.

You will optimize performance, implement CI/CD with GitHub Actions, collaborate with stakeholders, and guide production support while ensuring data security and governance across cloud deployments.