Lead Data Engineer - GCP Data Pipelines & BigQuery

EPAM Systems; Kuala Lumpur; Presencial; MYR 180 000 - 360 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Transparent career path

Individual roadmap to engineer your未来

Online courses, mentoring programs, &c

Resumo da oferta

EPAM Systems in Kuala Lumpur is seeking a Lead Data Engineer to design and implement scalable data pipelines using Python, SQL, Airflow and BigQuery on Google Cloud Platform. You will collaborate with engineering, analytics and product teams to deliver trusted datasets and data products while strengthening governance and platform standards.

You will also help strengthen governance, performance and platform standards, partnering across teams and contributing to runbooks and data models.

Qualificações

• Hands-on Python for data transformation and pipeline development.
• Practical knowledge of Apache Airflow for orchestration and scheduling.
• Experience with Google Cloud Platform (GCP), including BigQuery.
• Strong understanding of data modeling, ETL design and data warehousing concepts.
• Familiarity with CI/CD practices and GitHub.
• Clear communication and confidence collaborating across teams.

Responsabilidades

• Design, build, optimize and monitor scalable data pipelines using Python and SQL
• Develop and operate ETL/ELT workflows orchestrated with Apache Airflow
• Create, maintain and tune data models and warehouse structures in BigQuery
• Build and support data infrastructure and platform operations on Google Cloud Platform (GCP)
• Partner with engineering, analytics and product teams to deliver trusted datasets and data products
• Document designs, changes and runbooks in Jira and Confluence
• Improve data governance, architectural standards and platform performance

Conhecimentos

Python

SQL

Airflow

BigQuery

GCP

Data modeling

ETL design

Data warehousing

CI/CD

GitHub

Ferramentas

Terraform

BIML

Google Dataflow

Descrição da oferta de emprego

EPAM Systems in Kuala Lumpur is seeking a Lead Data Engineer to design and implement scalable data pipelines using Python, SQL, Airflow and BigQuery on Google Cloud Platform. You will collaborate with engineering, analytics and product teams to deliver trusted datasets and data products while strengthening governance and platform standards.

You will also help strengthen governance, performance and platform standards, partnering across teams and contributing to runbooks and data models.