Senior Data Engineer

Outstaffer.AI; Philippines; On-site; PHP 700,000 - 1,200,000; Full time

Benefits offered by this job

PTO credits (20 days)

HMO coverage up to USD 500,000

Government-mandated benefits (SSS,Phil

Pag-IBIG

Job summary

Outstaffer.AI is seeking an experienced Azure Data Engineer to join a healthcare client team in the Philippines. You will design scalable data pipelines using Azure Databricks and Spark, implement lakehouse architectures with Microsoft Fabric, and enforce governance with Purview.

The role requires strong PySpark and SQL skills, experience with Azure Data Lake/Synapse/Data Factory, and a track record in regulated healthcare environments.

Qualifications

• 5+ years hands-on Azure Databricks and Spark in development and production environments.
• Proven experience with Microsoft Purview for governance, cataloging, and compliance.
• Working knowledge of Microsoft Fabric for modern analytics and integration.
• Strong proficiency in Python (PySpark) and SQL.
• Solid understanding of data lake architecture, ETL processes, and data quality management.
• Experience with Azure data services such as Azure Data Lake, Synapse Analytics, and Data Factory.
• Ability to optimize performance and scalability for large-scale data processing.
• Excellent technical writing and communication skills.
• Experience working in regulated environments (healthcare experience is a strong plus).

Responsibilities

• Design, develop, and implement scalable data processing pipelines using Azure Databricks and Spark.
• Write efficient and optimized Python (PySpark) and SQL code for large-scale data processing.
• Architect and maintain data lakehouse solutions, leveraging Microsoft Fabric for analytics and reporting.
• Implement data governance, cataloging, lineage, and compliance using Microsoft Purview.
• Build and optimize ETL workflows for ingestion, transformation, and integration across Azure services.
• Ensure data quality, security, privacy, and integrity, aligned with healthcare data standards.
• Collaborate with cross-functional teams and stakeholders operating in the US time zone.
• Maintain version control using Git and follow CI/CD best practices for data engineering.
• Produce clear and comprehensive technical documentation (requirements, design, testing, and implementation).

Skills

Azure Databricks

Spark

Python (PySpark)

SQL

Microsoft Purview

Microsoft Fabric

Azure Data Lake

Synapse Analytics

Data Factory

Tools

Git

Azure DevOps

Job description

We are on the lookout for a skilled Azure Data Engineer to join our dynamic team for a healthcare industry client. This role focuses on building secure, scalable, and compliant data solutions that support healthcare analytics and reporting.

The ideal candidate brings strong hands-on experience with Azure Databricks, Microsoft Purview, and Microsoft Fabric, along with a deep understanding of data engineering best practices and governance - critical in regulated healthcare environments.

What You'll Do

• Design, develop, and implement scalable data processing pipelines using Azure Databricks and Spark
• Write efficient and optimized Python (PySpark) and SQL code for large-scale data processing
• Architect and maintain data lakehouse solutions, leveraging Microsoft Fabric for analytics and reporting
• Implement data governance, cataloging, lineage, and compliance using Microsoft Purview
• Build and optimize ETL workflows for ingestion, transformation, and integration across Azure services
• Ensure data quality, security, privacy, and integrity, aligned with healthcare data standards
• Collaborate with cross-functional teams and stakeholders operating in the US time zone
• Maintain version control using Git and follow CI/CD best practices for data engineering
• Produce clear and comprehensive technical documentation (requirements, design, testing, and implementation)

What We're Looking For

• 5+ years of hands‑on experience with Azure Databricks and Spark in development and production environments
• Proven experience with Microsoft Purview for data governance, cataloging, and compliance
• Working knowledge of Microsoft Fabric for modern analytics and integration
• Strong proficiency in Python (PySpark) and SQL
• Solid understanding of data lake architecture, ETL processes, and data quality management
• Experience with Azure data services such as Azure Data Lake, Synapse Analytics, and Data Factory
• Ability to optimize performance and scalability for large‑scale data processing
• Excellent technical writing and communication skills
• Experience working in regulated environments (healthcare experience is a strong plus
• 20 PTO credits upon regularization
• Comprehensive HMO coverage up to USD 500,000
• Government‑mandated benefits (SSS, PhilHealth, Pag-IBIG)
• Opportunity to work on impactful projects for a leading healthcare client
• Collaborative and growth‑oriented work environment