Senior Data Engineer, GCP Data Pipelines & Real-Time

Gratitude Philippines; Manila; On-site; PHP 2,009,000 - 2,678,000; Full time

Job summary

Gratitude Philippines is seeking a highly skilled Senior Data Engineer to design, build, and optimize our data platform on Google Cloud Platform. You will own batch and streaming pipelines, handle complex ingestions, and ensure the reliability of our data ecosystem.

The role emphasizes optimizing SQL queries, orchestrating workflows with Apache Beam/Airflow, and monitoring using GCP tools. Manila office-based, local applicants only.

Qualifications

• Minimum 2 years of relevant experience required.
• Experience with batch and real-time data processing (Pub/Sub to Dataflow).
• Proficiency in SQL and Python or Java for Beam/Airflow.
• Strong monitoring, logging, and alerting on GCP.

Responsibilities

• Design, build, and optimize a data platform on GCP.
• Develop robust batch and streaming data pipelines.
• Ingest and process various file formats (Avro, Parquet, JSON, CSV).
• Troubleshoot high-throughput data streams and optimize SQL queries.

Skills

SQL mastery

Python or Java

GCP Dataflow

Data pipelines

Monitoring & logging

Tools

BigQuery

Cloud Composer

Dataflow

Pub/Sub

Cloud Spanner

Job description

Gratitude Philippines is seeking a highly skilled Senior Data Engineer to design, build, and optimize our data platform on Google Cloud Platform. You will own batch and streaming pipelines, handle complex ingestions, and ensure the reliability of our data ecosystem.

The role emphasizes optimizing SQL queries, orchestrating workflows with Apache Beam/Airflow, and monitoring using GCP tools. Manila office-based, local applicants only.