Data Engineer

Information Professionals, Inc.; Mandaluyong; On-site; PHP 800,000 - 1,600,000; Full time

Job summary

Information Professionals, Inc. seeks a data engineer to design and optimize data pipelines and architectures in a dynamic cloud environment. You will implement validation and monitoring to ensure data quality and reliability across multiple data platforms.

You will collaborate with cross-functional teams to keep datasets clean, efficient, and scalable while tuning performance and enabling faster data processing for analytics and reporting tasks.

Qualifications

• Build and maintain robust ETL/ELT pipelines.
• Design scalable data warehouses, lakes, and lakehouses.
• Implement automated data quality validation, cleansing, and monitoring systems.
• Optimize slow-running queries and data processing jobs.
• Collaborate with technical teams to maintain clean datasets.

Responsibilities

• Build and maintain robust ETL/ELT pipelines.
• Design scalable data warehouses, lakes, and lakehouses.
• Implement automated data quality validation, cleansing, and monitoring systems.
• Optimize slow-running queries and data processing jobs.
• Collaborate with technical teams to maintain clean datasets.

Skills

ETL/ELT pipelines

Data architecture

Data quality monitoring

Performance tuning

Collaborating with technical teams

Cloud data modeling

Tools

Terraform

CloudFormation

Dagster

CI/CD Pipelines

Git

Prefect

Apache Airflow

Spark

Dataproc

BigQuery

Redshift

Azure Synapse

EMR

Python

SQL

Job description

Job Description

• Pipeline Development: Build and maintain robust ETL/ELT pipelines
• Data Architecture: Design scalable data warehouses, lakes, and lakehouses
• Data Quality: Implement automated validation, cleansing, and monitoring systems
• Performance Tuning: Optimize slow-running queries and data processing jobs
• Collaboration: Work with technical teams to maintain clean datasets

PRIMARY SKILLS

• Terraform or CloudFormation, CI/CD Pipelines, or Dagster DevOps / DataOps
• Proficiency with Git, Prefect, and Data Vault Orchestration
• Experience Managing Workflows using Apache Airflow, star/snowflake schemas, or Hadoop Data Modeling
• Expertise in Kimball Methodology, Flink, Dataproc) is a plus.
• Big Data Frameworks: Hands on Experience with Apache Spark, Data Factory) / GCP (BigQuery, Redshift).
• Knowledge of Azure (Synapse, EMR, Cloud Platforms)
• Extensive Experience with AWS (Glue, and Scala or Java, SQL, Python