Senior Data Engineer: Cloud ETL/ELT Pipelines

EPAM Systems; Kuala Lumpur; On-site; MYR 180,000 - 300,000; Full time

Benefits offered by this job

Newsweek recognition

Mentoring program

Online courses

Certification grants

Job summary

EPAM Systems in Kuala Lumpur is seeking a Senior Data Engineer to design, build and run reliable ETL and ELT pipelines for enterprise data platforms using Python, SQL and Apache Airflow across Azure, GCP or AWS. You will troubleshoot issues, improve delivery automation and partner with clients on requirements and trade-offs.

The role emphasizes scalable pipelines, complex SQL, data modeling and warehousing, Airflow orchestration, and CI/CD improvements, while collaborating with cross‑functional

Qualifications

• Hands-on experience building ETL/ELT pipelines and data warehousing.
• Advanced SQL skills including optimization and data validation.
• Python proficiency for pipeline development.
• Experience with distributed processing using PySpark or Apache Beam.
• Cloud experience with Azure, GCP or AWS for data workloads.
• Workflow orchestration with Airflow or Cloud Composer.
• Knowledge of data modeling and data quality control.
• Clear communication of trade-offs, risks and options.

Responsibilities

• Design and build scalable ETL/ELT pipelines using Python, SQL and cloud-native services.
• Write, optimize and troubleshoot complex SQL for transformations, validation and performance.
• Create and maintain data models and warehouse structures that support quality, availability and scale.
• Orchestrate workflows in Apache Airflow including scheduling, monitoring and incident resolution.
• Support pipeline delivery and platform operations across Azure, GCP or AWS.
• Improve CI/CD, source control and automated deployment for data solutions.
• Investigate data, integration and infrastructure issues; drive root-cause analysis.
• Collaborate with clients and cross-functional teams to align on requirements and delivery plans.

Skills

ETL pipelines

SQL

Python

PySpark

Apache Beam

Airflow

Cloud platforms

Data modeling

Data quality

Communication

Tools

Apache Airflow

PySpark

Apache Beam

Azure

GCP

AWS

Job description

EPAM Systems in Kuala Lumpur is seeking a Senior Data Engineer to design, build and run reliable ETL and ELT pipelines for enterprise data platforms using Python, SQL and Apache Airflow across Azure, GCP or AWS. You will troubleshoot issues, improve delivery automation and partner with clients on requirements and trade-offs.

The role emphasizes scalable pipelines, complex SQL, data modeling and warehousing, Airflow orchestration, and CI/CD improvements, while collaborating with cross‑functional