Data Engineer: End-to-End Pipelines & Lakehouse on Azure

HABIB Group; Selangor; On-site; MYR 120,000 - 150,000; Full time

Job summary

A prominent data solutions company based in Malaysia seeks an experienced Data Engineer to design and maintain data pipelines and develop data lakes. The ideal candidate will have 6+ years of experience, strong skills in SQL and Python, and a proven track record in building production data platforms. The role involves working with hybrid environments and ensuring the security and performance of data solutions. Excellent communication skills are essential for collaboration with cross-functional teams.

Qualifications

• Bachelor’s degree or equivalent experience.
• 6+ years of hands‑on experience in data engineering.
• Proven experience building and supporting production data platforms.
• Strong skills in SQL and Python; experience with Apache Spark.
• Able to build datasets for BI tools such as Power BI, Tableau, or Qlik.

Responsibilities

• Design, build, and maintain data pipelines.
• Develop and manage data lake platforms.
• Implement scalable ETL solutions.
• Ensure data solutions are secure and optimized.
• Work closely with data scientists to deliver datasets.

Skills

Data engineering

SQL proficiency

Python programming

Apache Spark

Data lakes and warehouses

Data security

Communication skills

Education

Bachelor's degree in Computer Science, IT, Engineering, or related field

Tools

Databricks

Power BI

Tableau

Git

Azure DevOps

Job description

A prominent data solutions company based in Malaysia seeks an experienced Data Engineer to design and maintain data pipelines and develop data lakes. The ideal candidate will have 6+ years of experience, strong skills in SQL and Python, and a proven track record in building production data platforms. The role involves working with hybrid environments and ensuring the security and performance of data solutions. Excellent communication skills are essential for collaboration with cross-functional teams.