Senior Data Platform Engineer — Azure & Databricks

Whitehall Consulting; Taguig; Hybrid; PHP 1,000,000 - 1,600,000; Full time

Job summary

Whitehall Consulting is seeking a Senior Data Platform Engineer in Manila to design and optimize scalable data infrastructure on Microsoft Azure. You will modernize complex financial data processing using Databricks, Python, and PySpark to enable advanced analytics and reliable decision‑making.

The role requires hands-on experience building end‑to‑end pipelines, IaC with Terraform, and CI/CD via Azure DevOps, with a strong Agile/Scrum delivery mindset.

Qualifications

• Bachelor’s degree in IT, Engineering, Data Science or related field.
• Minimum 5 years hands-on experience in data/platform/software engineering.
• Proven track record building end-to-end data pipelines on Microsoft Azure, Databricks, Python, PySpark and PostgreSQL.
• Experience with Infrastructure as Code (Terraform), CI/CD (Azure DevOps), and microservices in Python/TypeScript.
• Strong ability to ingest data from varied sources and apply Agile/Scrum delivery.

Responsibilities

• Architect, implement, and maintain secure, scalable data pipelines and data lake/warehouse on Azure.
• Replatform legacy financial/Excel processes to Python and Databricks workflows.
• Build data integration microservices using Python/TypeScript and automate ingestions from SharePoint Online and Excel.
• Implement IaC with Terraform, plus CI/CD and automated testing via Azure DevOps.
• Monitor, optimize, and troubleshoot data platform performance with Agile/Scrum practices.

Skills

Data engineering

Azure

Databricks

Python

PySpark

Terraform

Azure DevOps

CI/CD

Agile/Scrum

Education

Bachelor’s degree in Information Technology, Engineering, Data Science

Tools

Databricks

Terraform

Azure DevOps

PostgreSQL

Job description

Whitehall Consulting is seeking a Senior Data Platform Engineer in Manila to design and optimize scalable data infrastructure on Microsoft Azure. You will modernize complex financial data processing using Databricks, Python, and PySpark to enable advanced analytics and reliable decision‑making.

The role requires hands-on experience building end‑to‑end pipelines, IaC with Terraform, and CI/CD via Azure DevOps, with a strong Agile/Scrum delivery mindset.