Lead Data Engineer: GCP Data Pipelines & Governance

EPAM Systems Inc; Malaysia; On-site; MYR 180,000 - 300,000; Full time

Job summary

EPAM Systems Inc in Malaysia is seeking a Lead Data Engineer to build scalable data pipelines across multiple domains using Python, SQL, Apache Airflow and BigQuery on Google Cloud Platform (GCP). You will deliver reliable cloud data products and help strengthen governance, performance and platform standards.

Responsibilities include designing and optimizing pipelines, orchestrating with Airflow, modeling and warehousing in BigQuery, building data infrastructure on GCP, and collaborating with

Qualifications

• Hands-on Python for data transformation and pipeline development.
• Practical knowledge of Apache Airflow for orchestration and scheduling.
• Experience with Google Cloud Platform (GCP), including BigQuery.
• Strong understanding of data modeling, ETL design and data warehousing concepts.
• Familiarity with CI/CD practices and GitHub.
• Clear communication across teams.

Responsibilities

• Design, build, optimize and monitor scalable data pipelines using Python and SQL.
• Develop and operate ETL/ELT workflows orchestrated with Apache Airflow.
• Create, maintain and tune data models and warehouse structures in BigQuery.
• Build and support data infrastructure and platform operations on Google Cloud Platform (GCP).
• Partner with engineering, analytics and product teams to deliver trusted datasets and data products.
• Document designs, changes and runbooks in Jira and Confluence.
• Improve data governance, architectural standards and platform performance.

Skills

Python

Airflow

BigQuery

Data modeling

CI/CD

GitHub

Communication

Tools

Jira

Confluence

Job description

EPAM Systems Inc in Malaysia is seeking a Lead Data Engineer to build scalable data pipelines across multiple domains using Python, SQL, Apache Airflow and BigQuery on Google Cloud Platform (GCP). You will deliver reliable cloud data products and help strengthen governance, performance and platform standards.

Responsibilities include designing and optimizing pipelines, orchestrating with Airflow, modeling and warehousing in BigQuery, building data infrastructure on GCP, and collaborating with