Senior Data Pipeline Engineer

Digital Room; Mandaluyong; On-site; PHP 900,000 - 1,300,000; Full time

Job summary

Digital Room is seeking a Data Engineer 2 in Manila to own end-to-end data pipelines, from ingestion to publishing, with hands-on responsibility for orchestration, lineage, and dataset modeling. You will build robust batch, streaming, and CDC-enabled pipelines, optimize storage formats, and ensure data quality and lineage across platforms.

The role emphasizes design decisions beyond individual tasks, with a focus on scalable data architectures, reproducible data, and clear documentation.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or related field, or equivalent practical experience.
• At least 3 years building and operating production data pipelines (not solely analytics or reporting).
• Strong Python at production quality: modular code, error handling, logging, configuration, and tests.
• Advanced SQL, including window functions, multi-step CTE transformations, and set operations; read an execution plan and explain slow queries.
• Hands-on AWS data services: S3, Glue, Lambda, and Redshift, plus at least one of DMS, Kinesis, EMR, Step Functions, or Athena.
• Experience loading and querying non-transactional stores, including a data lake on object storage.
• Production experience with at least one orchestration framework, and understanding of workflow design, dependencies, idempotency, retries, and backfills.
• Data modeling ability: dimensional and/or wide-table designs, grain and key definition, and slowly changing dimensions.
• Data quality as routine practice: automated tests and reconciliation; CI-based deployment.
• Clear written and verbal communication.

Responsibilities

• Build and maintain batch, incremental, and near-real-time pipelines from various sources to data stores.
• Implement change data capture (CDC) on high-volume source tables, handling drift and out-of-order records.
• Write idempotent, restartable jobs ensuring consistent results on re-runs.
• Apply load patterns (full refresh, watermark-based incremental, merge/upsert, slowly changing dimensions).
• Write and tune complex SQL; read query plans and address performance issues.
• Apply business rules in a testable layer; design orchestration and observability.
• Model data with clear grain, keys, and measures; consider Parquet/ORC formats and storage layouts.
• Maintain dataset catalogs, perform impact analysis before schema changes, enforce data quality gates.
• Provide production support and on-call incident response; document datasets and pipelines clearly.
• Mentor Level 1 engineers; participate in design/code reviews to improve maintainability and cost.

Skills

Python production quality

Advanced SQL

AWS data services

Data modeling

Data quality practices

Git CI/CD

Communication skills

Education

Bachelor’s degree in Computer Science, Information Technology, or related field

Tools

dbt

Dagster

Prefect

Terraform

CloudFormation

CDK

Spark

Trino

Athena

OpenLineage/Marquez

Job description

Digital Room is seeking a Data Engineer 2 in Manila to own end-to-end data pipelines, from ingestion to publishing, with hands-on responsibility for orchestration, lineage, and dataset modeling. You will build robust batch, streaming, and CDC-enabled pipelines, optimize storage formats, and ensure data quality and lineage across platforms.

The role emphasizes design decisions beyond individual tasks, with a focus on scalable data architectures, reproducible data, and clear documentation.