Azure Data Engineer

Scicom MSC Berhad; Kampung Cendana; On-site; MYR 89,000 - 112,000; Full time

Benefits offered by this job

Performance bonus

Annual leave

Medical leave

Medical coverage

Salary range RM 8k-10k

Job summary

Scicom MSC Berhad is seeking an Azure Data Engineer to optimize enterprise cloud data operations focused on Microsoft Azure, Databricks cluster management, and robust ETL/ELT pipelines. The role emphasizes health and performance of data lakes and warehouses with comprehensive monitoring and logging strategies.

You will oversee Databricks management, develop data workflows, and implement monitoring using Azure Monitor, Log Analytics, and Datadog to proactively resolve bottlenecks and ensure data

Qualifications

• Bachelor's degree or above in a technical field
• 3–5 years of professional cloud operations experience with a focus on Microsoft Azure
• 2+ years hands-on Databricks experience (cluster management, data pipelines, performance)
• Solid understanding of ETL/ELT, data lakes and data warehouses
• Experience with monitoring/logging tools: Azure Monitor, Log Analytics, Datadog
• Excellent written and verbal English; Chinese skills a plus

Responsibilities

• Oversee cloud data operations with a focus on Azure
• Perform Databricks administration: cluster config, scaling and performance tuning
• Develop and maintain ETL/ELT data pipelines across data lakes and warehouses
• Implement robust monitoring and logging using Azure Monitor, Log Analytics and Datadog

Skills

Azure cloud operations

Databricks administration

Data pipeline development

Monitoring & logging

English communication

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Azure Monitor

Log Analytics

Datadog

Job description

The Position:

We are seeking an Azure Data Engineer to support and optimize our enterprise cloud data operations. The successful candidate will focus heavily on the Microsoft Azure ecosystem, managing Databricks clusters, developing robust ETL/ELT data pipelines, and ensuring the health and performance of data lakes and data warehouses through comprehensive monitoring and logging strategies.

The Responsibilities of the Role:

• Cloud Data Operations: Oversee and manage cloud operations with a strong focus on the Microsoft Azure environment.
• Databricks Administration: Execute hands-on Databricks management, including cluster configuration, resource scaling, and performance optimization for data workloads.
• Data Pipeline Management: Develop, maintain, and troubleshoot complex ETL/ELT workflows, ensuring seamless data flow across data lakes and data warehouses.
• System Monitoring: Implement and manage robust monitoring and logging solutions using Azure Monitor, Log Analytics, and Datadog to proactively identify and resolve pipeline bottlenecks.

The Requirement for the Role:

• Bachelor's degree or above, majoring in Computer Science or a related technical field
• 3 to 5 years of professional experience in cloud operations, with a strong, demonstrable focus on Microsoft Azure.
• 2+ years of hand-on experience working directly with Databricks, including cluster management, data pipeline development and performance optimization.
• Solid familiarity with core data engineering concepts, including ETL/ELT workflows, data lakes, and data warehouses.
• Practical experience with monitoring and logging tools such as Azure Monitor, Log Analytics, and Datadog.
• Good written and verbal communication skills in English, if know Chinese will be a plus.

The Package:

• Attractive Salary (RM 8,000 to RM 10,000).
• Performance related bonus for confirmed staff.
• Annual Leave 15 days.
• Medical Leave 14 days.
• Medical and hospitalization coverage.