Databricks Data Engineer — Cloud Pipelines & Data Products

EPAM Systems Inc; Malaysia; On-site; MYR 80,000 - 140,000; Full time

Job summary

EPAM Systems Inc. is seeking an experienced Data Integration Engineer specialized in Databricks to design enterprise data products and pipelines that deliver value and meet business goals.

You will collaborate with stakeholders to create engaging solutions using your design skills and methods. Responsibilities include developing ETL/ELT solutions, managing Databricks pipelines on Azure or AWS, and transforming data with SQL and Python while working with analytics and business teams to ensure

Qualifications

• Strong experience in data integration and Databricks.
• Proficient SQL and Python for data transformation and analysis.
• Knowledge of Delta Lake concepts (tables, partitions, schema evolution).
• Familiarity with cloud platforms (Azure, AWS).
• Hands-on experience building data pipelines on Databricks with cross-functional teams.

Responsibilities

• Develop, maintain, and support ETL/ELT solutions.
• Implement and manage Databricks pipelines/notebooks on Azure or AWS.
• Transform and analyze large datasets using SQL/Python and PySpark/Scala.
• Collaborate with analytics, data science, and business teams to deliver reliable data products.
• Create technical documentation and ensure best practices in development, testing, and deployment.

Skills

Data integration

Databricks

ETL/ELT

SQL

Python

Delta Lake

Cloud platforms

Data pipelines

English communication

Education

Bachelor's degree in Computer Science/IT or related

Tools

Databricks

Delta Lake

Azure

AWS

Job description

EPAM Systems Inc. is seeking an experienced Data Integration Engineer specialized in Databricks to design enterprise data products and pipelines that deliver value and meet business goals.

You will collaborate with stakeholders to create engaging solutions using your design skills and methods. Responsibilities include developing ETL/ELT solutions, managing Databricks pipelines on Azure or AWS, and transforming data with SQL and Python while working with analytics and business teams to ensure