Senior Data Platform Engineer

Datamatics; Metro Manila; On-site; PHP 1,200,000 - 1,800,000; Full time

Job summary

Datamatics is seeking a senior data engineer to design, build, and maintain scalable data pipelines and data lake/warehouse architectures on Microsoft Azure. You will collaborate with product teams and stakeholders to define data requirements and ensure reliable data solutions.

Expertise with Databricks, Python, PySpark, and PostgreSQL is essential, along with Terraform and CI/CD practices. The role requires strong communication skills and experience delivering in Agile environments, such as

Qualifications

• At least five years of experience in data engineering, platform engineering, or software engineering.
• Strong analytical and problem-solving skills.
• Experience with Microsoft Azure cloud services, including CI/CD pipelines and Azure DevOps.
• Practical experience with Databricks, Python, and PySpark.

Responsibilities

• Design, build, and maintain scalable data pipelines on Azure.
• Monitor, optimize, and troubleshoot data platform performance and reliability.
• Collaborate with product delivery teams and stakeholders to define data requirements.
• Apply SDLC best practices, testing, deployment, and CI/CD.

Skills

Azure

Databricks

Python

PySpark

PostgreSQL

Terraform

CI/CD

REST API

Agile/Scrum

Data pipelines

Tools

Azure Data Factory

Azure DevOps

Databricks

Terraform

PostgreSQL

Job description

• Design, build, and maintain scalable, secure, and cost-efficiency data pipelines and data lake/warehouse architectures on Microsoft Azure.
• Support the adoption and implementation of modern data engineering tools and frameworks, including Databricks and Azure Data Factory.
• Monitor, optimize, and troubleshoot data platform performance, reliability, and operational efficiency.
• Collaborate with product delivery teams and business stakeholders to define data requirements and deliver reliable data solutions.
• Prepare high-level and detailed technical designs for data solutions.
• Apply best practices in software development, testing, deployment, and CI/CD automation.
• Participate in Agile delivery processes, including Scrum and Kanban ceremonies.
• Stay current with emerging data and analytics technologies and recommend continuous improvements.

Relevant Experience and Other Requirements:

• At least five years of experience in data engineering, platform engineering, or software engineering, including the architecture, design, and development of integrated systems.
• Strong analytical and problem-solving skills.
• Proven experience with Microsoft Azure cloud services, including CI/CD pipelines and Azure DevOps.
• Proven experience with Infrastructure as Code (IaC) tools such as Terraform.
• Proven experience developing microservices for data integration using TypeScript or Python.
• Hands-on experience developing data pipelines and modern data warehouse solutions using Databricks, Python, and PySpark.
• Practical experience with relational databases, particularly PostgreSQL.
• Experience ingesting data from SharePoint Online, Excel files, and other enterprise data sources.
• Knowledge of Power BI semantic models, DAX, and REST API integration is an advantage.
• Familiarity with software development lifecycle (SDLC), project management methodologies, and Agile frameworks such as Scrum or Kanban.
• Relevant certifications in Secure Coding, Scrum, DevOps, Azure, or Databricks are an advantage.
• Experience working in collaborative teams of five or more members.
• Ability to engage effectively with senior executives and stakeholders from diverse cultural backgrounds.
• Excellent oral and written communication skills in English.