Senior Data Engineer

UST USource; Bayan Lepas; On-site; MYR 120,000 - 150,000; Full time

Job summary

A leading technology company in Malaysia is seeking a skilled Senior Azure Data Engineer to join its Data & Analytics team. This role focuses on designing, developing, implementing, and maintaining scalable data solutions on the Microsoft Azure platform. The ideal candidate will have over 6 years of experience in data engineering, solid proficiency in SQL, and hands-on experience with Azure core services. This position requires someone who can collaborate effectively with analysts and data scientists while optimizing data pipelines for performance and cost-effectiveness.

Qualifications

• 6+ years of experience in data engineering or related roles.
• 4+ years of experience developing data solutions on Microsoft Azure.
• Strong SQL skills and good proficiency with Python or Scala.

Responsibilities

• Design and deploy ETL/ELT data pipelines using Azure services.
• Implement data transformations and ensure data quality.
• Collaborate with analysts and users to translate requirements into solutions.

Skills

Data engineering

Azure Data Factory

Azure Synapse Analytics

ETL/ELT processes

SQL proficiency

Data modeling

Version control with Git

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Databricks

Azure Data Lake Storage (ADLS Gen2)

Job description

You can now search for people on SEEK. Make your profile public so you can be found by more employers. Update profile visibility

Add expected salary to your profile for insights

We are seeking a skilled Senior Azure Data Engineer to join a Data & Analytics team. This role focuses on designing, developing, implementing, and maintaining scalable and reliable data solutions on the Microsoft Azure platform. The Azure Data Engineer will build and optimize data pipelines, ensure data quality, and collaborate with analysts, data scientists, and other stakeholders to support data-driven initiatives.

Key Responsibilities

• Design, develop, test, and deploy ETL/ELT data pipelines using Azure services such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
• Implement data transformations, data cleaning, aggregation, and enrichment logic according to business requirements.
• Build and maintain data structures and models within Azure Data Lake Storage and Azure Synapse Analytics (or other data warehousing solutions).
• Monitor data pipeline execution, troubleshoot failures, and optimize performance and cost-effectiveness.
• Implement data quality checks and processes to ensure data accuracy and reliability.
• Collaborate with data analysts, data scientists, and business users to understand data requirements and translate them into technical solutions.
• Work closely with senior engineers and architects, contributing to solution design and adhering to established best practices.
• Create and maintain clear technical documentation for data pipelines and processes.

Required Skills and Experience

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field (or equivalent practical experience).
• Minimum 6+ years of experience in data engineering, business intelligence, or related roles involving data integration and transformation.
• Minimum 4+ years of hands-on experience developing and implementing data solutions specifically on the Microsoft Azure platform.
• Core Azure Data Services: Solid experience with Azure Data Factory (ADF), Azure Synapse Analytics (SQL/Spark Pools), Azure Databricks, and Azure Data Lake Storage (ADLS Gen2).
• Data Processing & Programming: Strong proficiency with SQL is essential. Good proficiency with Spark (using PySpark or Scala) and Python (preferred) or Scala for data manipulation.
• Data Concepts: Understanding of data warehousing concepts, dimensional modeling, ETL/ELT patterns, and data lake principles.
• Databases: Experience with relational databases (e.g., Azure SQL Database). Familiarity with NoSQL databases is a plus.
• Version Control: Experience using Git for code management.

Unlock job insights

Be careful This job ad has not been subjected to our hirer verification process. Proceed cautiously and do your own checks before providing any personal information. Learn how to protect yourself Report this job ad