Data Engineer: Lakehouse Pipelines & Azure

HABIB Group; Hulu Kelang; On-site; MYR 90,000 - 120,000; Full time

Job summary

A leading analytics firm is seeking a Data Engineer to support the Senior Manager of Analytics & Insights. You will design and maintain data infrastructure while ensuring data security and reliability. The role requires over 6 years of experience in data engineering, strong skills in SQL and Python, and familiarity with cloud environments such as Azure. Excellent communication skills and the ability to collaborate with cross-functional teams are essential for success. This position is based in Hulu Kelang, Selangor, Malaysia.

Qualifications

• Minimum of 6 years of hands-on experience in data engineering.
• Advanced proficiency in SQL and Python, expertise in Spark.
• Experience with relational and NoSQL databases.

Responsibilities

• Design and implement data ingestion and transformation pipelines.
• Build and maintain scalable data lake/lakehouse environments.
• Collaborate with data scientists to translate business requirements.

Skills

SQL

Python

Spark

Data Governance

DataOps

MLOps

Communication

Education

Bachelor’s degree in Computer Science or related field

Tools

Azure Data Lake

Databricks

JupyterHub

Power BI

Tableau

Git

Azure DevOps

GitHub Actions

Job description

A leading analytics firm is seeking a Data Engineer to support the Senior Manager of Analytics & Insights. You will design and maintain data infrastructure while ensuring data security and reliability. The role requires over 6 years of experience in data engineering, strong skills in SQL and Python, and familiarity with cloud environments such as Azure. Excellent communication skills and the ability to collaborate with cross-functional teams are essential for success. This position is based in Hulu Kelang, Selangor, Malaysia.