Senior Data Engineer: Cloud ETL/ELT & Data Warehousing

EPAM Systems, Inc.; Kuala Lumpur; On-site; MYR 120,000 - 180,000; Full time

Job summary

EPAM Systems, Inc. is seeking a Senior Data Engineer to design, build and run reliable ETL and ELT pipelines for enterprise data platforms, using Python, SQL and Apache Airflow across Microsoft Azure, Google Cloud Platform (GCP) or Amazon Web Services (AWS).

You will design data models, optimize transformations and ensure scalability for analytics at scale in Kuala Lumpur, Malaysia. Work with cross-functional teams and clients to translate requirements into robust data solutions, troubleshoot

Qualifications

• ETL/ELT pipelines and data warehousing experience.
• Advanced SQL for transformations, validation and performance.
• Python for pipeline development and software engineering practices.
• Cloud experience across Azure, GCP or AWS.
• Experience with PySpark or Apache Beam.
• Airflow or Cloud Composer for workflow orchestration.

Responsibilities

• Design and build scalable ETL and ELT pipelines.
• Write, optimize and troubleshoot complex SQL for transformations.
• Create and maintain data models and warehouse structures.
• Orchestrate workflows in Apache Airflow.
• Support CI/CD and automated deployment for data solutions.
• Collaborate with clients and cross-functional teams on requirements.

Skills

Python

SQL

Airflow

Cloud platforms

PySpark/Beam

CI/CD

Data modeling

Kubernetes

Terraform

Communication

Tools

Apache Airflow

PySpark

Terraform

Kubernetes

Fivetran

Job description

EPAM Systems, Inc. is seeking a Senior Data Engineer to design, build and run reliable ETL and ELT pipelines for enterprise data platforms, using Python, SQL and Apache Airflow across Microsoft Azure, Google Cloud Platform (GCP) or Amazon Web Services (AWS).

You will design data models, optimize transformations and ensure scalability for analytics at scale in Kuala Lumpur, Malaysia. Work with cross-functional teams and clients to translate requirements into robust data solutions, troubleshoot