Senior Data Engineer

Manulife; Quezon City; Hybrid; PHP 900,000 - 1,500,000; Full time

Job summary

Manulife is seeking a Senior Data Engineer to design and maintain scalable ETL/ELT pipelines in MS Azure, including Databricks and ADLS Gen2. You will shape data architecture and collaborate with data scientists and analysts to meet analytics needs.

You will join a hybrid team with 3 onsite days weekly and occasional night shifts to align with business requirements. Strong skills in Java/Scala, Python, and SQL are valued.

Qualifications

• 5+ years of experience as Data Engineer.
• 5+ years building data pipelines in MS Azure using Azure Databricks.
• Experience automating data pipelines and familiarity with DevOps and CICD.
• Good knowledge of MS Azure services and data warehousing concepts.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and other services.
• Develop and maintain data architecture including data models, schemas, and data dictionaries.
• Integrate data from various sources and ensure data quality for analytics and operations.
• Follow data governance policies to ensure security, privacy, and compliance.
• Collaborate with data scientists, analysts, and business teams to meet data needs.
• Stay updated with big data and cloud tech to improve data infra.

Skills

Cloud data engineering

Data governance

SQL

Python

Java/Scala

Tools

Azure Data Factory

Azure Databricks

ADLS Gen2

Synapse

SQL Server

DevOps

JIRA

Job description

As a Senior Data Engineer at Manulife, you will play a critical role in the development and maintenance of the company's data systems and architecture. You will collaborate with other highly skilled data engineers, data architects and governance team in designing, developing, and deploying data pipelines, ETL processes, and other data integration solutions to extract, transform, and load data from various sources into Manulife's data warehouse.

This Data Engineer role is essential for driving efficiency and innovation within our organization. By developing and maintaining automation, this position helps streamline operations and improve efficiency, contributing to our mission of delivering high-quality products and platform services. This role is integral to our goal of continuous improvement and operational excellence.

Position Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and other relevant services
• Develop and maintain the company's data architecture, including data models, schemas, and data dictionaries.
• Integrate data from various sources, ensuring data quality and consistency, and prepare it for analytical and operational use
• Follow consistency of data governance policies and processes to ensure data security, privacy, and compliance.
• Collaborate with other data professionals, including data scientists, analysts, and business team members, to understand data requirements and develop solutions to meet those needs.
• Stay up to date with the latest tools and technologies and see opportunities to enhance Manulife's data infrastructure.
• Ability to learn and implement best practices of big data and cloud computing to ensure solutions are scalable, efficient, and effective.

Required Qualifications

• 5+ of relevant industry experience as Data Engineer
• 5+ years of experience in building and operationalizing Data pipelines in cloud MS Azure using Azure Databricks.
• Experience in automating data pipelines and familiarity with DevOps and CICD pipelines
• Good working knowledge on MS azure services (SQL Queries, ADLS gen 2, ADF, Databricks, Synapse, SQL Server) to design a data ecosystem.
• Good knowledge of data warehousing concepts and relational data modelling
• Familiarity with programming in both compile languages (Java, Scala) and scripting languages (Python, SQL, R)
• Understanding of Agile scrum methodologies and experience of working in an Agile team, with exposure to and working understanding of collaboration tools like Teams, JIRA, Mural
• Experience in Data processing, performance analysis, tuning and capacity planning
• Amenable to work on a hybrid set-up (3x onsite per week)
• Amenable to work on a night shift schedule (with flexibility for mid shift depending on business need)

Preferred Qualifications

• Excellent communication and interpersonal skills
• Excellent analytical, problem solving and solutioning skills
• A capacity for constant learning from both success and failure, remaining open to change and continuous improvement
• Familiarity with production release and operational support model

When You Join Our Team

• We’ll empower you to learn and grow the career you want.
• We’ll recognize and support you in a flexible environment where well-being and inclusion are more than just words.
• As part of our distributed team, we’ll support you in crafting the future you want to see!