Data Engineering Lead - Insurance

Michael Page International (HK) Ltd; Hong Kong Island; On-site; HKD 900,000 - 1,500,000; Full time

Job summary

Leading insurance firm is seeking a Data Engineering Lead to oversee data platforms, pipelines, and governance across multiple markets. You will translate business requirements into scalable technical solutions and provide architectural leadership for Azure and Databricks environments.

The role demands strong collaboration with regional teams, extensive SQL and Spark expertise, and a proven track record of delivering data-driven solutions in a fast-paced setting.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or related field.
• 8+ years IT experience with 5+ years in data engineering leadership or similar roles.
• Strong hands-on experience with Azure data services (ADLS, ADF, Synapse, Azure SQL).
• Deep expertise in Azure Databricks and Spark; modern ETL/ELT design.
• Relational databases experience (Oracle, SQL Server, PostgreSQL).
• Ability to lead large-scale data platform initiatives and communicate with stakeholders.
• Knowledge of Alibaba Cloud data technologies (DataWorks, MaxCompute, OSS, Hologres) preferred.
• Experience with BI tools like Power BI/Tableau/FineBI.

Responsibilities

• Collaborate with health business leaders, product owners, regional teams, and IT to gather requirements and drive delivery.
• Coordinate with regional teams to align data initiatives across markets.
• Translate requirements into epics, stories, and roadmaps for delivery.
• Design and maintain scalable data platforms, pipelines, data lakehouses, and enterprise data warehouses.
• Provide technical leadership for Azure and Databricks-based environments and establish standards.
• Build data ingestion, orchestration, transformation, and data quality frameworks.
• Drive data governance, security, and compliance across platforms.
• Lead code reviews, troubleshoot issues, and optimize costs.

Skills

Data engineering leadership

Azure data services

Azure Databricks

Apache Spark

Relational databases

Data governance

Stakeholder management

Cloud architecture

Education

Bachelor's or Master's degree in Computer Science/Information Systems/Engineering

Tools

ADLS

ADF

Azure Synapse

Azure SQL

Databricks

Apache Spark (PySpark)

Oracle

SQL Server

PostgreSQL

Power BI

FineBI

Tableau

AliCloud DataWorks

MaxCompute

OSS

Hologres

Job description

As a Data Engineering Lead in the insurance industry, you will oversee data engineering initiatives and drive technical excellence within the organisation. This temporary role offers the chance to lead innovative projects and support business growth through data-driven solutions.

Leading insurance firm

Description

As a Data Engineering Lead, your main responsibilities will include:

• Collaborate closely with Health business leaders, product owners, regional teams, and IT stakeholders to gather business requirements, define project scope, and drive successful delivery within agreed timelines.
• Partner with regional teams to align data initiatives, priorities, and implementation strategies across multiple markets.
• Perform effort estimation and project planning, translating complex business requirements into technical epics, user stories, and delivery roadmaps.
• Design, develop, and maintain scalable data platforms, including batch and real-time data pipelines, data lakehouses, and enterprise data warehouse solutions.
• Provide technical leadership for enterprise data environments, establishing architecture standards, engineering best practices, and platform optimization strategies across Azure Cloud and Databricks.
• Build and enhance data ingestion, orchestration, transformation, and data quality frameworks to ensure reliable and efficient data processing.
• Drive data governance, technical standards, and best practices to maintain data integrity, security, and compliance.
• Lead code reviews, technical troubleshooting, performance tuning, and cost-optimization initiatives to ensure robust and resilient data solutions.

Profile

A successful Data Engineering Lead should have:

• Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related discipline.
• Minimum 8 years of IT experience, including at least 5 years in data engineering leadership, technical lead, or solution delivery roles.
• Strong hands-on experience with Azure technologies, including Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), Azure Synapse Analytics, and Azure SQL.
• Deep expertise in Azure Databricks, Apache Spark (PySpark/Spark SQL), and modern ETL/ELT framework design and implementation.
• Solid experience with relational database technologies such as Oracle, SQL Server, or PostgreSQL.
• Proven ability to lead large-scale data platform initiatives and communicate complex technical concepts effectively to both technical and non-technical stakeholders.
• Familiarity with Alibaba Cloud (AliCloud) big data technologies, including DataWorks, MaxCompute, OSS, and Hologres, is highly desirable.
• Experience with data visualization and reporting tools such as Power BI, FineBI, Tableau, or similar enterprise BI platforms.
• Strong analytical, stakeholder management, and problem-solving skills, with the ability to work effectively in a fast-paced and collaborative environment.

Job Offer

This is a role to take on a leadership role in data engineering within the insurance sector.