Data Engineer

Leadingnation; Hong Kong; On-site; HKD 900,000 - 1,300,000; Full time

Job summary

Leadingnation is seeking an experienced data engineering leader to own delivery for Health IT initiatives in Hong Kong. You will translate business needs into scalable data platforms and clear roadmaps, partnering with Health leaders and IT stakeholders.

You will design and optimize batch and real-time pipelines on Azure and Databricks, drive governance, estimates, and code reviews, ensuring secure and cost-efficient solutions for enterprise-scale workloads.

Qualifications

• 8+ years IT experience with 5+ years in data engineering delivery leadership or technical lead roles.
• Experience with Agile methodology.
• Hands-on Azure Cloud Services, Oracle/SQL Server/PostgreSQL, Azure Databricks, Spark, PySpark, Spark SQL, ETL/ELT design, AliCloud DataWorks, MaxCompute, OSS, Hologres.
• Proficient in written and spoken English; local candidates only (visa sponsorship not available).

Responsibilities

• Partner with Health leaders, product owners and IT to capture requirements, define scope and deliver timelines.
• Collaborate with Health Regional teams.
• Break down initiatives into epics and user stories with estimates.
• Design, build and optimize batch and real-time data pipelines, data lakehouse architectures and warehousing solutions.
• Provide technical leadership for enterprise platforms on Azure and Databricks, drive best practices and cost optimization.
• Establish data governance and quality standards; conduct code reviews and troubleshoot pipelines.

Skills

Data engineering leadership

Azure Databricks

PySpark / Spark SQL

Agile methodologies

Tools

AliCloud DataWorks

MaxCompute

OSS

Hologres

Job description

Must-have criteria:

1. Minimum 8+ years of IT experience, with at least 5+ years specifically in data engineering delivery leadership or technical lead roles - with the ability to independently own and drive project delivery in a timely manner
2. Agile methodology
3. Hands-on experience with Azure Cloud Services, database technology (Oracle, SQL Server, or PostgreSQL), Azure Databricks, Apache Spark (PySpark / Spark SQL), and modern ETL/ELT pipeline design, AliCloud big data tools, specifically DataWorks, MaxCompute, OSS, and Hologres
4. Must be proficient in written and spoken English – only local candidates who do not require visa sponsorship will be considered

Good-to-have criteria:

1. Experience with FineBI, Power BI, Tableau or similar enterprise reporting tools
2. Any other language proficiencies

Position Responsibilities:

• Partner closely with Health business unit leaders, Health product owners, and IT stakeholders to capture business requirements, define project scopes, and establish clear delivery timelines.
• Partner and collaborate with Health Regional teams.
• Perform workload and effort estimation; break down complex data initiatives into detailed technical epics, user stories, and execution roadmaps.
• Design, build, and optimize scalable batch and real-time data pipelines, data lakehouse architectures, and data warehousing solutions.
• Provide technical leadership for enterprise data platforms, driving architecture, engineering best practices, platform optimization, and innovation across Azure Cloud and Databricks (Spark)
• Implement robust data orchestration, data ingestion, cleansing, transformation, augmentation, and data quality control processes.
• Establish and enforce technical quality standards, data governance frameworks, and best practices across data ingestion, storage, and processing.
• Conduct thorough code reviews, lead technical troubleshooting, and ensure data pipelines are secure, resilient, and cost-optimized