Databricks Data Integration Architect (Azure/AWS)

EPAM Systems; Kuala Lumpur; On-site; MYR 180,000 - 240,000; Full time

Job summary

EPAM Systems is seeking an experienced Senior Data Integration Engineer in Kuala Lumpur to design and deliver enterprise data platforms. You will lead Databricks-based ETL/ELT solutions, transform large datasets, and own end-to-end ingestion pipelines while collaborating with analytics and business teams to drive value.

You will leverage SQL, Python, and Delta Lake concepts across cloud environments (Azure/AWS) and implement best practices for development, testing and deployment, with strong

Qualifications

• 5+ years of experience in Data Integration and ETL/ELT with Databricks
• Strong SQL and Python skills and data modeling fundamentals
• Experience with Delta Lake concepts and schema evolution
• Cloud experience on Azure and AWS
• Developing data pipelines on Databricks and delivering reliable data products
• Orchestration experience with Databricks Workflows; ADF/Airflow is a plus
• Excellent verbal and written English communication

Responsibilities

• Develop, maintain and support ETL/ELT solutions on cloud platforms
• Implement and manage Databricks on Azure or AWS
• Transform and analyze large datasets using SQL, PySpark or Scala
• Own end-to-end data ingestion and transformation pipelines on Azure Databricks
• Work independently with minimal supervision
• Collaborate with analytics, data science and business teams
• Create technical documentation and ensure best practices in development, testing and deployment

Skills

Databricks

SQL

Python

ETL/ELT

Data integration

Dimensional modeling

Lakehouse modeling

Delta Lake

Azure

AWS

Data pipelines

Databricks Workflows

Airflow

English communication

Education

Bachelor's degree in CS/IT

Tools

Databricks

ADF

Airflow

Job description

EPAM Systems is seeking an experienced Senior Data Integration Engineer in Kuala Lumpur to design and deliver enterprise data platforms. You will lead Databricks-based ETL/ELT solutions, transform large datasets, and own end-to-end ingestion pipelines while collaborating with analytics and business teams to drive value.

You will leverage SQL, Python, and Delta Lake concepts across cloud environments (Azure/AWS) and implement best practices for development, testing and deployment, with strong