Senior Data Engineer

DysrupIT Pty; Manila; Hybrid; PHP 1,200,000 - 2,400,000; Full time

Job summary

DysrupIT Pty seeks a Senior Data Engineer to own ingestion, data model, and reconciliation layers of a financial billing data platform on Google Cloud Platform. Ensure every amount is accurate, traceable, and fully reconciled across source, staging, and output.

The ideal candidate has 6+ years in data engineering with BigQuery, Python, and SQL, and will design robust, auditable pipelines with data quality controls.

Qualifications

• 6+ years of data engineering experience.
• Experience with financial or billing data pipelines where every amount must reconcile.
• Strong Python, including pydantic and pytest.
• Advanced SQL skills with complex joins, window functions, and performance tuning.
• In-depth BigQuery experience with nested ARRAY/STRUCT, partitioning and clustering.
• Experience handling monetary values with NUMERIC types.
• Experience designing append-only tables and using views for data checks.
• Experience implementing data lineage and managing reference data.
• Knowledge of data quality practices, reconciliation checks, file validation and quarantine.

Responsibilities

• Design, build, and maintain data ingestion pipelines for financial and billing data on GCP.
• Design and evolve the BigQuery data model with nested structures and partitioning.
• Implement reconciliation checks for end-to-end accuracy across layers.
• Build file validation and quarantine processes for data quality control.
• Create idempotent, rerunnable pipelines and audit-ready data flows.
• Develop and optimize SQL for transformation, reconciliation, and reporting.
• Collaborate with engineers, analysts, and finance stakeholders to translate business rules into data logic.
• Mentor team members and contribute to engineering standards.

Skills

BigQuery

Python

SQL

Data modeling

Pydantic

Pytest

ETL pipelines

Data quality

Cloud services

GCP

Data lineage

Education

Bachelor's or Master's in CS/SE

Tools

BigQuery

Python

SQL

Cloud Storage

Cloud Run

Firestore

Job description

Job Description:

About Dysrupit

DysrupIT is a leading global-based cloud services company. We support clients across the globe in their adoption of the cloud and their transformation to as-a-Service business models. DysrupIT is dedicated to making a positive impact in the communities it serves.

Company Culture

We are constantly looking for talented people to join our team. We offer a unique and extraordinary career experience to motivate and inspire talents like you to make a difference in our customers, clients, and the entire organization. At DysrupIT, you’ll join a team of dedicated and brilliant professionals who share the same goal of pursuing integrity and excellence. We are committed to promoting a culture where employees are valued and respected. We invest in our employees and make sure that they will have the right training to secure their growth and advancement towards their career aspirations.

Job Summary

We are seeking a Senior Data Engineer to own the ingestion, data model, and reconciliation layers of a financial billing and invoicing data platform built on Google Cloud Platform (GCP). This role is responsible for ensuring that every amount flowing through the platform is accurate, traceable, and fully reconciled.

The ideal candidate has 6+ years of data engineering experience, including financial or billing pipelines, with deep BigQuery expertise and strong Python and SQL skills. You will design robust, auditable data pipelines with built-in data quality controls, and work closely with engineers and business stakeholders to deliver trusted financial data.

Job Responsibilities

• Design, build, and maintain data ingestion pipelines for financial and billing data on GCP.
• Design and evolve the BigQuery data model, including nested ARRAY/STRUCT tables, partitioning, and clustering strategies.
• Implement reconciliation checks to ensure every amount balance end to end across source, staging, and output layers.
• Build file validation and quarantine processes to detect, isolate, and report invalid or incomplete source data.
• Design idempotent pipelines that can be safely rerun without duplicating or corrupting data.
• Implement append-only table patterns and use views as data checks to support auditability.
• Handle monetary values accurately using BigQuery NUMERIC types and appropriate rounding rules.
• Manage effective-dated reference data such as rates, mappings, and customer attributes.
• Establish and maintain data lineage so that every output can be traced back to its source.
• Write clean, typed, and well-tested Python code using pydantic and pytest.
• Write and optimize advanced SQL for transformation, reconciliation, and reporting.
• Collaborate with engineers, analysts, and finance stakeholders to translate business rules into reliable data logic.
• Mentor team members and contribute to data engineering standards and best practices.

Required Technical Skillset

• 6+ years of data engineering experience.
• Proven experience building financial or billing pipelines where every amount must reconcile.
• Strong Python skills, including pydantic, typed code, and pytest.
• Advanced SQL skills, including complex joins, window functions, and performance tuning.
• In-depth Google BigQuery experience, including nested ARRAY/STRUCT tables, partitioning, and clustering.
• Experience handling money accurately using NUMERIC data types.
• Experience designing append-only tables and using views as data checks.
• Strong understanding of data quality practices, including reconciliation checks, file validation, and quarantine.
• Experience building idempotent, rerunnable pipelines.
• Experience implementing data lineage and managing effective-dated reference data.

Preferred Experience

• Invoicing domain experience, including credit notes, rebills, FX conversion, and month-end close.
• Experience working with finance or billing teams in a regulated or audited environment.
• Experience with other GCP services such as Cloud Storage, Cloud Run, or Firestore.

What We Offer

• Competitive compensation package commensurate with experience.
• Government-mandated benefits plus supplemental HMO coverage.
• Collaborative and professional work environment.
• Career growth opportunities within a growing organization.
• Hybrid/Remote work arrangement (where applicable).