Senior Data Engineer (Azure Databricks)

Manulife IT Delivery Center Asia Inc.; Philippines; Hybrid; PHP 1,200,000 - 2,400,000; Full time

Job summary

Manulife IT Delivery Center Asia Inc. in the Philippines is seeking a Senior Data Engineer (Azure Databricks) to support regional partners and mature the Enterprise Data Lake operations. This role focuses on building scalable data solutions within a data-driven culture.

You will implement ETL/ELT pipelines, monitor performance, contribute to data governance and cloud data services, and collaborate across Agile squads to deliver robust data platforms and insights.

Qualifications

• 8 years of relevant experience in Data Engineer, Platform Engineer, DevOps Engineer and Software Engineer.
• Proficient understanding of distributed computing principles.
• Good knowledge of Hadoop cluster, Azure, with all included services.
• Experience with Azure ADLS, Data Factory, Databricks, Event Hubs.
• Experience with data engineering projects and integrating data from multiple sources.
• Good knowledge of data querying tools – Azure Synapse Analytics, Databricks SQL Warehouse.
• Knowledge in data streaming (Event Hubs, Spark).
• Knowledge in Python and Spark.
• Knowledge in Change Data Capture (CDC) solutions (e.g. Debezium).
• Experience on Azure Cloud and/or other Cloud platforms
• Database development and management (e.g. Azure SQL, Cosmos).
• Strong understanding of Data Governance, Regulations and Compliance

Responsibilities

• Select and integrate Big Data tools and frameworks to deliver requested capabilities.
• Implement ETL/ELT flows via Spark, Python and Azure data services.
• Monitor performance and advise on infrastructure changes or tuning.
• Support business users in using the Enterprise Data Lake as part of BAU.
• Perform proofs of concept on new integration patterns and solutions.
• Maintain and monitor platform stability and performance of the EDL.
• Attend to incidents and change requests.
• Write and maintain technical documentation.
• Execute updates, patches, and other activities to maintain EDL operations.
• Support Agile delivery squads when required

Skills

Distributed computing principles

Azure cloud

Data governance & compliance

Agile methodologies

Tools

Azure Databricks

Azure Data Factory

Azure Synapse

Hadoop cluster

Event Hubs

Python

Spark

CDC Debezium

Cosmos DB

Azure SQL

Job description

The Asia Data Office is looking for an experienced Senior Data Engineer (Azure Databricks) to join our team to support our regional partners. If you have passion for data and a desire to drive quality data solutions within a data driven culture, then read on to learn more about this opportunity!

We are looking for the right individual who would be interested and enjoy the opportunity to support data operations, strong willingness to learn and build data operations skills through team collaboration, desire to drive and execute on our data strategy, willing to help mature our agile practices, and is looking for an opportunity to embrace technical, operational, and informal leadership roles on the team.

Position Responsibilities

• Selecting and integrating any Big Data tools and frameworks required providing requested capabilities
• Implement ETL/ELT flows via Big Data Solutions i.e. Spark, Python, Azure Data Factory, Azure Synapse, Azure Databricks, etc.
• To be able to monitor the performance and advice necessary infrastructure changes or performance tuning in codes.
• Support business users in use of the Enterprise Data Lake (EDL) as part of BAU
• Perform POC on new integration patterns and solutions.
• Maintain and monitor platform stability and performance of EDL
• Attends to Incidents and change requests
• Write and maintain technical documentation
• Perform unit tests and system integration tests
• Executes updates, patches, and other activities required to maintain and enhance the operations of the EDL
• Supports the Agile delivery squads when required

Required Qualifications

• 8 years of relevant experience in Dat Engineer, Platform Engineer, DevOps Engineer and Software Engineer
• Proficient understanding of distributed computing principles
• Good Knowledge of Hadoop cluster, Azure, with all included services
• Ability to solve any ongoing issues with operating the cluster
• Experience with Azure ADLS, Data Factory, Databricks, Event Hubs
• Experience with data engineering projects
• i.e. integration of data from multiple data sources to a target system
• Good knowledge of data querying tools – Azure Synapse Analytics, Databricks SQL Warehouse
• Knowledge in data streaming (e.g. Event Hubs, Spark)
• Knowledge in Python and Spark
• Knowledge in any Change Data Capture (CDC) solutions (e.g. Debezium)
• Experience in working on Agile projects is an advantage.
• Experience on Azure Cloud and/or other Cloud platforms
• Database development and management (e.g. Azure SQL, Cosmos)
• Good knowledge of insurance Data Domains (Policy, Claims, Underwriting, Customer, Finance & Distribution.
• Strong understanding of Data Governance, Regulations and Compliance

Preferred Qualifications

• ITIL certification helpful
• Project management experience is an advantage.
• Understanding of the insurance and/or financial industry is an asset
• Experience with Alibaba Cloud, AI/BI, and/or GenAI is an advantage.

When you join our team:

• We'll empower you to learn and grow the career you want.
• We'll recognize and support you in a flexible environment where well-being and inclusion are more than just words.
• As part of our global team, we'll support you in shaping the future you want to see.

About Manulife and John Hancock

Manulife Financial Corporation is a leading international financial services provider, helping people make their decisions easier and lives better. To learn more about us, visit https://www.manulife.com/en/about/our-story.html.

Manulife is an Equal Opportunity Employer

At Manulife/John Hancock, we embrace our diversity. We strive to attract, develop and retain a workforce that is as diverse as the customers we serve and to foster an inclusive work environment that embraces the strength of cultures and individuals. We are committed to fair recruitment, retention, advancement and compensation, and we administer all of our practices and programs without discrimination on the basis of race, ancestry, place of origin, colour, ethnic origin, citizenship, religion or religious beliefs, creed, sex (including pregnancy and pregnancy-related conditions), sexual orientation, genetic characteristics, veteran status, gender identity, gender expression, age, marital status, family status, disability, or any other ground protected by applicable law.

It is our priority to remove barriers to provide equal access to employment. A Human Resources representative will work with applicants who request a reasonable accommodation during the application process. All information shared during the accommodation request process will be stored and used in a manner that is consistent with applicable laws and Manulife/John Hancock policies. To request a reasonable accommodation in the application process, contact [HIDDEN TEXT].

Working Arrangement

Hybrid