Senior Azure Databricks Data Engineer (Hybrid)

Manulife IT Delivery Center Asia Inc.; Philippines; Ibrido; PHP 1.200.000 - 2.400.000; Tempo pieno

Descrizione del lavoro

Manulife IT Delivery Center Asia Inc. in the Philippines is seeking a Senior Data Engineer (Azure Databricks) to support regional partners and mature the Enterprise Data Lake operations. This role focuses on building scalable data solutions within a data-driven culture.

You will implement ETL/ELT pipelines, monitor performance, contribute to data governance and cloud data services, and collaborate across Agile squads to deliver robust data platforms and insights.

Competenze

• 8 years of relevant experience in Data Engineer, Platform Engineer, DevOps Engineer and Software Engineer.
• Proficient understanding of distributed computing principles.
• Good knowledge of Hadoop cluster, Azure, with all included services.
• Experience with Azure ADLS, Data Factory, Databricks, Event Hubs.
• Experience with data engineering projects and integrating data from multiple sources.
• Good knowledge of data querying tools – Azure Synapse Analytics, Databricks SQL Warehouse.
• Knowledge in data streaming (Event Hubs, Spark).
• Knowledge in Python and Spark.
• Knowledge in Change Data Capture (CDC) solutions (e.g. Debezium).
• Experience on Azure Cloud and/or other Cloud platforms
• Database development and management (e.g. Azure SQL, Cosmos).
• Strong understanding of Data Governance, Regulations and Compliance

Mansioni

• Select and integrate Big Data tools and frameworks to deliver requested capabilities.
• Implement ETL/ELT flows via Spark, Python and Azure data services.
• Monitor performance and advise on infrastructure changes or tuning.
• Support business users in using the Enterprise Data Lake as part of BAU.
• Perform proofs of concept on new integration patterns and solutions.
• Maintain and monitor platform stability and performance of the EDL.
• Attend to incidents and change requests.
• Write and maintain technical documentation.
• Execute updates, patches, and other activities to maintain EDL operations.
• Support Agile delivery squads when required

Conoscenze

Distributed computing principles

Azure cloud

Data governance & compliance

Agile methodologies

Strumenti

Azure Databricks

Azure Data Factory

Azure Synapse

Hadoop cluster

Event Hubs

Python

Spark

CDC Debezium

Cosmos DB

Azure SQL

Descrizione del lavoro

Manulife IT Delivery Center Asia Inc. in the Philippines is seeking a Senior Data Engineer (Azure Databricks) to support regional partners and mature the Enterprise Data Lake operations. This role focuses on building scalable data solutions within a data-driven culture.

You will implement ETL/ELT pipelines, monitor performance, contribute to data governance and cloud data services, and collaborate across Agile squads to deliver robust data platforms and insights.