Senior Data Engineer (Databrick)

Michael Page; Shah Alam; On-site; MYR 120,000 - 180,000; Full time

Benefits offered by this job

Competitive remuneration package

Comprehensive employee benefits

Job summary

Michael Page is recruiting a Senior Data Engineer in Malaysia to design, develop, and maintain scalable data pipelines using Databricks and PySpark. You will build ETL/ELT frameworks, develop Data Warehouse and Lakehouse solutions, and create dimensional models for analytics, BI, and AI/ML use cases.

The role emphasizes data governance, security, and platform performance, with opportunities to optimise PySpark workloads and implement CI/CD practices in Databricks environments.

Qualifications

• Bachelor's Degree in Computer Science, Information Technology, Engineering, Data Science, or a related discipline.
• Minimum 8 years of experience in Data Engineering, Data Warehousing, or Big Data environments.
• At least 4 years of hands-on experience with Databricks in enterprise-scale implementations.
• Strong expertise in PySpark, Data Lake, Delta Tables, ETL/ELT development, and modern Lakehouse architectures.
• Proven experience in designing enterprise Data Warehouse solutions and dimensional data models.
• Solid understanding of data governance, security frameworks, data lineage, and access control models.
• Experience implementing CI/CD pipelines, GitHub integration, and DevOps automation practices.
• Excellent stakeholder management and communication skills with the ability to translate business requirements into technical solutions.
• Strong analytical and troubleshooting capabilities with experience supporting mission-critical data platforms.

Responsibilities

• Design, develop, and maintain scalable data pipelines and data products using Databricks and PySpark.
• Build and optimize ETL/ELT frameworks supporting batch and near real-time processing.
• Develop enterprise Data Warehouse and Lakehouse solutions for analytics, reporting, and AI/ML use cases.
• Create and maintain dimensional data models including Fact and Dimension tables, Star Schema, Snowflake Schema, and Slowly Changing Dimensions (SCD).
• Ensure high standards of data quality, security, scalability, and platform performance.
• Implement Databricks governance solutions including Unity Catalog, RBAC, ABAC, data lineage, auditing, and secure data sharing frameworks.
• Drive platform optimization through advanced PySpark tuning, workload management, cluster optimization, and cost efficiency initiatives.
• Design and implement CI/CD pipelines, deployment automation, and DevOps best practices for Databricks environments.
• Collaborate with business stakeholders, architects, analysts, and technology teams to deliver scalable data solutions.
• Provide technical guidance to team members and participate in production support and incident management activities.

Skills

Stakeholder management

Analytical skills

Communication

Troubleshooting

Education

Bachelor's degree in Computer Science or related

Tools

Databricks

PySpark

GitHub

CI/CD

DevOps

Job description

Jora Malaysia will close on 16th September 2026. Thank you for being with us, we are cheering you on as you continue your career journey.

• Superb remuneration package and benefits
• Work with cutting-edge Databricks technologies at enterprise scale

Responsibility

• Superb remuneration package and benefits
• Work with cutting-edge Databricks technologies at enterprise scale

About Our Client

Our client is a leading multinational technology organisation with a strong global presence and a reputation for delivering innovative digital and enterprise solutions. As part of its continued investment in data and analytics capabilities, the organisation is expanding its data engineering function to support large-scale transformation initiatives, advanced analytics, and AI-driven business outcomes.

Job Description

• Design, develop, and maintain scalable data pipelines and data products using Databricks and PySpark.
• Build and optimize ETL/ELT frameworks supporting batch and near real-time processing.
• Develop enterprise Data Warehouse and Lakehouse solutions for analytics, reporting, and AI/ML use cases.
• Create and maintain dimensional data models including Fact and Dimension tables, Star Schema, Snowflake Schema, and Slowly Changing Dimensions (SCD).
• Ensure high standards of data quality, security, scalability, and platform performance.
• Implement Databricks governance solutions including Unity Catalog, RBAC, ABAC, data lineage, auditing, and secure data sharing frameworks.
• Drive platform optimization through advanced PySpark tuning, workload management, cluster optimization, and cost efficiency initiatives.
• Design and implement CI/CD pipelines, deployment automation, and DevOps best practices for Databricks environments.
• Collaborate with business stakeholders, architects, analysts, and technology teams to deliver scalable data solutions.
• Provide technical guidance to team members and participate in production support and incident management activities.

The Successful Applicant

A Successful Senior Data Engineer Should Have

• Bachelor's Degree in Computer Science, Information Technology, Engineering, Data Science, or a related discipline.
• Minimum 8 years of experience in Data Engineering, Data Warehousing, or Big Data environments.
• At least 4 years of hands-on experience with Databricks in enterprise-scale implementations.
• Strong expertise in PySpark, Data Lake, Delta Tables, ETL/ELT development, and modern Lakehouse architectures.
• Proven experience in designing enterprise Data Warehouse solutions and dimensional data models.
• Solid understanding of data governance, security frameworks, data lineage, and access control models.
• Experience implementing CI/CD pipelines, GitHub integration, and DevOps automation practices.
• Excellent stakeholder management and communication skills with the ability to translate business requirements into technical solutions.
• Strong analytical and troubleshooting capabilities with experience supporting mission-critical data platforms.

What's on Offer

• Competitive annual salary ranging from MYR 120,000 to MYR 180,000.
• Opportunity to shape and influence an enterprise-scale modern data platform.
• Exposure to the latest Databricks ecosystem technologies and data governance frameworks.
• High-impact role supporting advanced analytics, business intelligence, and AI/ML initiatives.
• Collaborative environment working alongside experienced data, architecture, and technology teams.
• Strong career progression opportunities within a growing and data-driven organisation.
• Competitive remuneration package and comprehensive employee benefits.

Contact

Quote job ref: JN-092026-7098533