Senior Data Engineer - Real-Time Pipelines (DBT, Airflow)

Pan Asia Resources; Taguig; On-site; PHP 1,200,000 - 1,800,000; Full time

Job summary

Pan Asia Resources is seeking a data engineering professional to design and build data pipelines and ETL processes. The role requires leading automation of workflows and managing dependencies using Apache Airflow and DBT. Real-time streaming experience with Kafka, Pub/Sub, and PySpark/Dataflows is essential.

Proficiency in Python and SQL, and hands-on work with Google BigQuery are required to ensure scalable data platforms and timely analytics.

Qualifications

• + Fluent in Python and SQL.
• + Experience designing and building data pipelines and ETL processes.
• + Leading workflows automation and managing task dependencies using Apache Airflow and DBT.
• + Experience with real-time streaming pipelines (Kafka/PubSub) and PySpark/Dataflows.

Responsibilities

• Lead the design and construction of end-to-end data pipelines and ETL workflows.
• Manage workflow automation, task dependencies, and data transformations with Airflow and DBT.
• Build and optimize real-time streaming pipelines using Kafka/PubSub and PySpark/DataFlows.

Skills

Python

SQL

ETL design

Data pipelines

Airflow

DBT

BigQuery

Real-time streaming

PySpark/Dataflows

Tools

DBT

Google BigQuery

Python

Apache Airflow

Job description

Pan Asia Resources is seeking a data engineering professional to design and build data pipelines and ETL processes. The role requires leading automation of workflows and managing dependencies using Apache Airflow and DBT. Real-time streaming experience with Kafka, Pub/Sub, and PySpark/Dataflows is essential.

Proficiency in Python and SQL, and hands-on work with Google BigQuery are required to ensure scalable data platforms and timely analytics.