Intelligence Data Engineer - Azure & Databricks

E-Outsource Asia; Kuala Lumpur; On-site; MYR 150,000 - 210,000; Full time

Job summary

E-Outsource Asia in Kuala Lumpur is seeking a Senior Data Engineer to design, develop, and maintain scalable ETL/ELT pipelines on Azure Databricks and ADF. You will build Lakehouse patterns, Delta Lake datasets, and production-grade data quality checks.

You will collaborate with cross-functional teams, optimize performance and costs, implement CI/CD for data jobs, and contribute to data governance with Purview or Alation.

Qualifications

• 3+ years of leadership in delivery and design.

Responsibilities

• Design, develop, test, deploy and maintain ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks.

Skills

Databricks PySpark

SQL

Python

Azure Data Factory

ADLS Gen2

CI/CD

Data quality checks

Performance tuning

Communication skills

Education

Bachelor’s degree in Information Systems/CS/Data Management

Tools

Power BI

Looker

Tableau

Microsoft Purview

Alation

Databricks runtimes

Job description

E-Outsource Asia in Kuala Lumpur is seeking a Senior Data Engineer to design, develop, and maintain scalable ETL/ELT pipelines on Azure Databricks and ADF. You will build Lakehouse patterns, Delta Lake datasets, and production-grade data quality checks.

You will collaborate with cross-functional teams, optimize performance and costs, implement CI/CD for data jobs, and contribute to data governance with Purview or Alation.