Data Engineering Lead: Azure & Databricks Architect

Michael Page International (HK) Ltd; Hong Kong Island; On-site; HKD 900,000 - 1,500,000; Full time

Job summary

Leading insurance firm is seeking a Data Engineering Lead to oversee data platforms, pipelines, and governance across multiple markets. You will translate business requirements into scalable technical solutions and provide architectural leadership for Azure and Databricks environments.

The role demands strong collaboration with regional teams, extensive SQL and Spark expertise, and a proven track record of delivering data-driven solutions in a fast-paced setting.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or related field.
• 8+ years IT experience with 5+ years in data engineering leadership or similar roles.
• Strong hands-on experience with Azure data services (ADLS, ADF, Synapse, Azure SQL).
• Deep expertise in Azure Databricks and Spark; modern ETL/ELT design.
• Relational databases experience (Oracle, SQL Server, PostgreSQL).
• Ability to lead large-scale data platform initiatives and communicate with stakeholders.
• Knowledge of Alibaba Cloud data technologies (DataWorks, MaxCompute, OSS, Hologres) preferred.
• Experience with BI tools like Power BI/Tableau/FineBI.

Responsibilities

• Collaborate with health business leaders, product owners, regional teams, and IT to gather requirements and drive delivery.
• Coordinate with regional teams to align data initiatives across markets.
• Translate requirements into epics, stories, and roadmaps for delivery.
• Design and maintain scalable data platforms, pipelines, data lakehouses, and enterprise data warehouses.
• Provide technical leadership for Azure and Databricks-based environments and establish standards.
• Build data ingestion, orchestration, transformation, and data quality frameworks.
• Drive data governance, security, and compliance across platforms.
• Lead code reviews, troubleshoot issues, and optimize costs.

Skills

Data engineering leadership

Azure data services

Azure Databricks

Apache Spark

Relational databases

Data governance

Stakeholder management

Cloud architecture

Education

Bachelor's or Master's degree in Computer Science/Information Systems/Engineering

Tools

ADLS

ADF

Azure Synapse

Azure SQL

Databricks

Apache Spark (PySpark)

Oracle

SQL Server

PostgreSQL

Power BI

FineBI

Tableau

AliCloud DataWorks

MaxCompute

OSS

Hologres

Job description

Leading insurance firm is seeking a Data Engineering Lead to oversee data platforms, pipelines, and governance across multiple markets. You will translate business requirements into scalable technical solutions and provide architectural leadership for Azure and Databricks environments.

The role demands strong collaboration with regional teams, extensive SQL and Spark expertise, and a proven track record of delivering data-driven solutions in a fast-paced setting.