Senior Data Engineer - Pipelines & Lakehouse

DigitalRoom; Philippines; Vor Ort; PHP 900.000 - 1.500.000; Vollzeit

Zusammenfassung

DigitalRoom seeks a Data Engineer 2 in the Philippines to own and operate end-to-end data pipelines. You will work hands-on with AWS services (S3, Glue, Lambda, Redshift) and implement CDC, data quality gates, and robust orchestration.

You will design data models, manage lineage, and collaborate with stakeholders to deliver reliable datasets for analytics and AI systems. Ideal candidates have 3+ years building production data pipelines, strong Python and SQL, and experience with CI-driven

Qualifikationen

• Bachelor's degree or equivalent practical experience.
• 3+ years building and operating production data pipelines.
• Proficient Python with production-grade practices.
• Advanced SQL with window functions and multi-CTE transformations.
• Hands-on AWS data services: S3, Glue, Lambda, Redshift.
• Understanding of columnar storage and data lake concepts.
• Experience with at least one orchestration framework and CI-based deployment.
• Data modeling with dimensional/wide-table designs and slowly changing dimensions.
• Strong written and verbal communication.

Aufgaben

• Own end-to-end data pipelines: ingestion, transformation, publishing, monitoring, and support.
• Build and maintain batch, incremental, and streaming pipelines from multiple sources.
• Implement CDC and handle schema drift and late-arriving data.
• Write idempotent, restartable jobs and justify load strategies.
• Design orchestration layer and observability, including backfills and failure strategies.
• Model data with clear grain, keys, and measures; manage file layouts in object storage.
• Contribute to data quality, testing, and documentation.

Kenntnisse

Python

SQL

Data pipelines

ETL/ELT

Git/CI

Data modeling

Communication

Ausbildung

Bachelor's degree in CS/IT or equivalent

Tools

S3

Glue

Lambda

Redshift

DMS

Kinesis

EMR

Step Functions

Athena

Jobbeschreibung

DigitalRoom seeks a Data Engineer 2 in the Philippines to own and operate end-to-end data pipelines. You will work hands-on with AWS services (S3, Glue, Lambda, Redshift) and implement CDC, data quality gates, and robust orchestration.

You will design data models, manage lineage, and collaborate with stakeholders to deliver reliable datasets for analytics and AI systems. Ideal candidates have 3+ years building production data pipelines, strong Python and SQL, and experience with CI-driven