Senior Data Platform Engineer

Whitehall Consulting; Taguig; Hybrid; PHP 1,000,000 - 1,600,000; Full time

Job summary

Whitehall Consulting is seeking a Senior Data Platform Engineer in Manila to design and optimize scalable data infrastructure on Microsoft Azure. You will modernize complex financial data processing using Databricks, Python, and PySpark to enable advanced analytics and reliable decision‑making.

The role requires hands-on experience building end‑to‑end pipelines, IaC with Terraform, and CI/CD via Azure DevOps, with a strong Agile/Scrum delivery mindset.

Qualifications

• Bachelor’s degree in IT, Engineering, Data Science or related field.
• Minimum 5 years hands-on experience in data/platform/software engineering.
• Proven track record building end-to-end data pipelines on Microsoft Azure, Databricks, Python, PySpark and PostgreSQL.
• Experience with Infrastructure as Code (Terraform), CI/CD (Azure DevOps), and microservices in Python/TypeScript.
• Strong ability to ingest data from varied sources and apply Agile/Scrum delivery.

Responsibilities

• Architect, implement, and maintain secure, scalable data pipelines and data lake/warehouse on Azure.
• Replatform legacy financial/Excel processes to Python and Databricks workflows.
• Build data integration microservices using Python/TypeScript and automate ingestions from SharePoint Online and Excel.
• Implement IaC with Terraform, plus CI/CD and automated testing via Azure DevOps.
• Monitor, optimize, and troubleshoot data platform performance with Agile/Scrum practices.

Skills

Data engineering

Azure

Databricks

Python

PySpark

Terraform

Azure DevOps

CI/CD

Agile/Scrum

Education

Bachelor’s degree in Information Technology, Engineering, Data Science

Tools

Databricks

Terraform

Azure DevOps

PostgreSQL

Job description

Manila, Philippines | Hybrid (3 days onsite/week) | 1-Year Fixed-Term Contract

About the Role

We are seeking a Senior Data Platform Engineer to design, build, and optimize scalable, enterprise-grade data infrastructure on Microsoft Azure. In this key role, you will lead the modernization of complex financial projection and data processing architectures into high-performance cloud solutions. By leveraging modern data engineering tools like Databricks and Python, you will enable advanced analytics and support data-driven decision-making across the organization.

Key Responsibilities

• Architect, implement, and maintain secure, scalable, and cost-efficient data pipelines and data lake/warehouse solutions on Microsoft Azure.
• Reprogram legacy financial calculation logic and Excel/VBA processes into modern Python and Databricks workstreams.
• Build modern data integration microservices using Python or TypeScript, and automate ingestions from enterprise sources like SharePoint Online and Excel.
• Implement Infrastructure as Code (IaC) using Terraform, alongside CI/CD pipelines and automated testing via Azure DevOps.
• Optimize, monitor, and troubleshoot data platform performance while ensuring alignment with Agile, Scrum, and security best practices.

Qualifications

• Bachelor’s degree in Information Technology, Engineering, Data Science, or a related field.
• Minimum 5 years of hands‑on experience in data engineering, platform engineering, or software engineering.
• Proven track record building end-to-end data pipelines using Microsoft Azure, Databricks, Python, PySpark, and relational databases like PostgreSQL.
• Practical experience with Infrastructure as Code (Terraform), CI/CD pipelines (Azure DevOps), and microservices creation (Python/TypeScript).
• Strong expertise in ingesting data from varied sources and familiarity with Agile/Scrum delivery methodologies.