Lead Data Engineer

TASQ Staffing Solutions; Philippines; On-site; PHP 670,000 - 1,116,000; Full time

Job summary

TASQ Staffing Solutions in the Philippines is seeking an experienced Azure Data Engineer to design, build, and maintain scalable data pipelines on Microsoft Azure. You will develop end‑to‑end data solutions for multiple business needs.

Key responsibilities include implementing data security, governance, and privacy controls, monitoring data workflows, and optimizing storage and processing with Azure services such as Synapse, Databricks, and Fabric. Strong Python and SQL skills are required.

Qualifications

• 4+ years hands-on data engineering in Azure.
• Experience with ETL using Azure Data Factory.
• Experience with Spark, Python, SQL, and Databricks.

Responsibilities

• Design, build, and maintain scalable data solutions on Azure.
• Develop and manage data pipelines ingesting, transforming, and integrating data.
• Implement data security, governance, and privacy controls.
• Monitor, troubleshoot, and optimize data workflows for reliability and cost efficiency.
• Optimize data storage and processing using Azure best practices.
• Collaborate with teams to ensure end-to-end data ingestion and processing.

Skills

Azure Data Engineering

Data pipelines

Python

SQL

Azure Synapse

Azure Databricks

Spark

Data security

Governance

RDBMS

Tools

Azure DevOps

Git

VSTS

Power BI

Job description

• Design, build, and maintain scalable data solutions on Microsoft Azure to support business data needs.
• Develop and manage data pipelines for ingesting, transforming, and integrating data from multiple sources.
• Implement data security, governance, and privacy controls across Azure data platforms.
• Monitor, troubleshoot, and optimize data workflows to ensure reliability, performance, and cost efficiency.
• Optimize data storage and processing solutions by leveraging Azure best practices and services.
• An Azure Data Engineer is responsible for designing, building, and maintaining scalable data framework on the Azure data requirements. The role involves developing and managing end‑to‑end data pipelines, integrating data from multiple sources, and ensuring reliable data ingestion, transformation and processing using spark. The Azure Data Engineer also implements data security, privacy, and governance controls, monitors and troubleshoots data workflows, and continuously optimizes data storage and processing to achieve high performance and cost efficiency across Azure data platforms
• Minimum 4 years hands-on experience in software development with significant focus on Azure Data Engineering
• 3+ years of consulting or client service delivery experience in Azure Microsoft data engineering.
• 1+ year of experience building data ingestion, data processing, and analytics pipelines using SQL Server, Azure Synapse, Azure Databricks, and Microsoft Fabric.
• Hands‑on experience with ETL and data processing using Azure Data Factory, Azure Functions, ADLS, OneLake, and Microsoft Fabric services.
• 1+ year of experience in Azure and Big Data technologies, including Fabric, Databricks, Python, SQL, ADLS/Blob Storage, Spark, and Spark SQL.
• 1+ year of experience working with RDBMS technologies.
• Experience with big data file formats and compression techniques.
• Proficiency with developer tools such as Azure DevOps, Git, and Visual Studio Team Services (VSTS).

Preferred technical & functional skills

• Experience in designing and deploying ETL solutions on Azure Cloud using Azure Data Factory, Synapse Analytics, Azure Functions, and Notebooks.
• Hands‑on experience with Microsoft Fabric, including Medallion Architecture, metadata‑driven ingestion frameworks, data quality frameworks, and SCD Type 1 & Type 2 transformations using Fabric Notebooks or Azure Databricks.
• Exposure to Microsoft Copilot, Generative AI fundamentals, and industry‑relevant AI use cases is a plus. Microsoft role‑based certifications such as DP‑600, DP-700,, DP‑203, DP‑900, AI‑102, AI‑900 are preferred.
• Knowledge of Microsoft Power BI to develop reports and dashboards and deliver business insights.
• Understanding of Azure RBAC and IAM, including access control and cloud security concepts.
• Strong interest in Microsoft’s vision and roadmap and adoption of the latest tools and technologies.