Senior Data Engineer (Databrick)

Michael Page; Kuala Selangor; On-site; MYR 120,000 - 180,000; Full time

Benefits offered by this job

Competitive salary package

Exposure to enterprise Databricks

Job summary

Michael Page Malaysia is recruiting a Senior Data Engineer to design and maintain scalable data pipelines and data products using Databricks and PySpark. The role develops enterprise Data Warehouse and Lakehouse solutions for analytics, reporting, and AI/ML use cases.

The candidate will create dimensional models including Fact and Dimension tables, Star and Snowflake schemas, and Slowly Changing Dimensions, while ensuring data quality, security, and performance at scale.

Qualifications

• Bachelor's degree in a technical field required.
• 8+ years in Data Engineering, Data Warehousing or big data environments.
• Strong PySpark, Databricks, and Lakehouse experience.
• Proven ability to design enterprise DW and dimensional models.
• Experience implementing CI/CD pipelines and DevOps best practices.

Responsibilities

• Design, develop, and maintain scalable data pipelines and data products using Databricks and PySpark.
• Build and optimize ETL/ELT frameworks for batch and near real-time processing.
• Develop enterprise Data Warehouse and Lakehouse solutions for analytics and AI/ML use cases.
• Create dimensional data models including Fact/Dimension tables, Star/Snowflake schemas, and SCDs.
• Ensure data quality, security, scalability, and platform performance.
• Implement Databricks governance solutions including Unity Catalog, RBAC, ABAC, data lineage, and auditing.
• Optimize platform performance via PySpark tuning, workload management, and cost efficiency.
• Design and implement CI/CD pipelines, deployment automation, and DevOps for Databricks.
• Collaborate with stakeholders and technology teams to deliver scalable data solutions.
• Provide technical guidance and participate in production support and incident management.

Skills

Databricks

PySpark

ETL/ELT

Data Warehouse

Lakehouse

Dimensional data models

CI/CD pipelines

DevOps

Data governance

Security & RBAC/ABAC

Education

Bachelor's Degree in Computer Science, IT, Engineering, Data Science, or related

Tools

Unity Catalog

RBAC/ABAC frameworks

Data lineage tooling

GitHub integration

Job description

Jora Malaysia will close on 16th September 2026. Thank you for being with us, we are cheering you on as you continue your career journey.

• Design, develop, and maintain scalable data pipelines and data products using Databricks and PySpark.
• Build and optimize ETL/ELT frameworks supporting batch and near real-time processing.
• Develop enterprise Data Warehouse and Lakehouse solutions for analytics, reporting, and AI/ML use cases.
• Create and maintain dimensional data models including Fact and Dimension tables, Star Schema, Snowflake Schema, and Slowly Changing Dimensions (SCD).
• Ensure high standards of data quality, security, scalability, and platform performance.
• Implement Databricks governance solutions including Unity Catalog, RBAC, ABAC, data lineage, auditing, and secure data sharing frameworks.
• Drive platform optimization through advanced PySpark tuning, workload management, cluster optimization, and cost efficiency initiatives.
• Design and implement CI/CD pipelines, deployment automation, and DevOps best practices for Databricks environments.
• Collaborate with business stakeholders, architects, analysts, and technology teams to deliver scalable data solutions.
• Provide technical guidance to team members and participate in production support and incident management activities.

• Design, develop, and maintain scalable data pipelines and data products using Databricks and PySpark.
• Build and optimize ETL/ELT frameworks supporting batch and near real-time processing.
• Develop enterprise Data Warehouse and Lakehouse solutions for analytics, reporting, and AI/ML use cases.
• Create and maintain dimensional data models including Fact and Dimension tables, Star Schema, Snowflake Schema, and Slowly Changing Dimensions (SCD).
• Ensure high standards of data quality, security, scalability, and platform performance.
• Implement Databricks governance solutions including Unity Catalog, RBAC, ABAC, data lineage, auditing, and secure data sharing frameworks.
• Drive platform optimization through advanced PySpark tuning, workload management, cluster optimization, and cost efficiency initiatives.
• Design and implement CI/CD pipelines, deployment automation, and DevOps best practices for Databricks environments.
• Collaborate with business stakeholders, architects, analysts, and technology teams to deliver scalable data solutions.
• Provide technical guidance to team members and participate in production support and incident management activities.

Superb remuneration package and benefitsWork with cutting-edge Databricks technologies at enterprise scale

A successful Senior Data Engineer should have:

• Bachelor's Degree in Computer Science, Information Technology, Engineering, Data Science, or a related discipline.
• Minimum 8 years of experience in Data Engineering, Data Warehousing, or Big Data environments.
• At least 4 years of hands-on experience with Databricks in enterprise-scale implementations.
• Strong expertise in PySpark, Data Lake, Delta Tables, ETL/ELT development, and modern Lakehouse architectures.
• Proven experience in designing enterprise Data Warehouse solutions and dimensional data models.
• Solid understanding of data governance, security frameworks, data lineage, and access control models.
• Experience implementing CI/CD pipelines, GitHub integration, and DevOps automation practices.
• Excellent stakeholder management and communication skills with the ability to translate business requirements into technical solutions.
• Strong analytical and troubleshooting capabilities with experience supporting mission-critical data platforms.

Our client is a leading multinational technology organisation with a strong global presence and a reputation for delivering innovative digital and enterprise solutions. As part of its continued investment in data and analytics capabilities, the organisation is expanding its data engineering function to support large-scale transformation initiatives, advanced analytics, and AI-driven business outcomes.

• Competitive annual salary ranging from MYR 120,000 to MYR 180,000.
• Opportunity to shape and influence an enterprise-scale modern data platform.
• Exposure to the latest Databricks ecosystem technologies and data governance frameworks.
• High-impact role supporting advanced analytics, business intelligence, and AI/ML initiatives.
• Collaborative environment working alongside experienced data, architecture, and technology teams.
• Strong career progression opportunities within a growing and data-driven organisation.
• Competitive remuneration package and comprehensive employee benefits.