Data Engineer Lead 54K

Michael Page International (Hong Kong) Limited; Hong Kong; On-site; HKD 781,000 - 1,451,000; Full time

Benefits offered by this job

Competitive salary

Contractor benefits

Job summary

Michael Page International (Hong Kong) Limited seeks a Data Engineer Lead to guide a data engineering team and shape scalable data platforms. You will drive technical direction, review designs, and ensure delivery excellence across Spark on AWS EMR and streaming APIs.

You will promote MLOps, collaborate with data science teams, and contribute to governance, security, and cost-efficient solutions while mentoring engineers and engaging stakeholders.

Qualifications

• Bachelor's degree or equivalent technical experience.
• 6+ years in data engineering with leadership experience.
• Ability to present complex tech to varied audiences.
• Proven Spark on AWS EMR, including performance optimization and cost management.
• Experience designing streaming API services for real-time data.
• Strong AWS data services knowledge (S3, Glue, Lake Formation, Athena, Redshift).
• Proficiency in Python; React/Node.js in BFF a plus.
• Understand MLOps and self-service data science capabilities.
• Experience with Kafka or Spark Streaming and SQL/data modelling.

Responsibilities

• Lead and mentor a data engineering team to deliver scalable data solutions.
• Provide hands-on technical direction, review designs and code, uphold quality standards.
• Design solutions aligned with architecture standards and governance.
• Communicate technical approaches to stakeholders and project teams.
• Optimize Spark workloads on AWS EMR for batch and real-time processing.
• Oversee streaming API services for real-time data ingestion and delivery.
• Enable self-service data access for data science teams with governed data assets.
• Promote MLOps practices, including deployment and monitoring of models.
• Contribute to Frontend-for-Backend components using React/Node.js.
• Collaborate with stakeholders and platform teams to translate business needs into scalable solutions.
• Drive data governance across quality, lineage, integrity, and security.

Skills

Data engineering leadership

Apache Spark on AWS EMR

Streaming API design

Python

SQL

Data modeling

MLOps

Kafka

Communication & coaching

Education

Bachelor's degree in CS/Engineering/Data Science

Tools

Spark

Kafka

React

Node.js

AWS Lambda

Job description

About Our Client

Our client is a technology-focused organisation operating a modern cloud data environment. The team works closely with business and technical stakeholders to deliver data, analytics, and machine learning capabilities through scalable engineering solutions.

Job Description

• Lead and develop a team of data engineers, providing coaching to strengthen technical capability and delivery excellence.
• Offer hands-on technical direction by defining engineering best practices, reviewing solution designs and code, and promoting high-quality outcomes.
• Propose and detail solution designs that align with established architecture standards, governance requirements, and delivery frameworks.
• Communicate technical approaches effectively to stakeholders and project teams, explaining key design choices and associated trade-offs.
• Guide the development and optimisation of Apache Spark workloads on AWS EMR for both batch and real-time data processing.
• Oversee the design and management of streaming API solutions supporting real-time ingestion, consumption, and data delivery.
• Support self-service data access for data science users through curated data assets and governed delivery mechanisms, recommending suitable implementation approaches.
• Advocate strong MLOps practices, including model deployment, monitoring, and lifecycle support within the platform environment.
• Contribute to the delivery of lightweight user-facing and service-layer components using React and Node.js within a Backend-for-Frontend architecture.
• Collaborate with stakeholders, data science teams, and platform specialists to convert business requirements into scalable, secure, and cost-efficient solutions.
• Drive best practices in data governance, covering data quality, lineage, integrity, and security throughout the data lifecycle.
• Participate in emerging AI and generative AI-related initiatives, contributing ideas and technical input where appropriate.

The Successful Applicant

• Bachelor's degree in Computer Science, Engineering, Data Science, or a related technical discipline, or equivalent industry experience.
• At least 6 years of experience in data engineering, including demonstrated experience leading and mentoring engineering teams.
• Strong technical leadership capabilities with experience establishing standards, mentoring engineers, and reviewing designs and code.
• Ability to communicate and present technical solutions effectively to both technical and non-technical audiences.
• Proven hands-on expertise with Apache Spark running on AWS EMR, including pipeline architecture, performance optimisation, and cost management.
• Experience designing and supporting streaming API services for real-time data ingestion, consumption, and API-driven delivery.
• Solid experience across AWS data services including S3, Glue, Lake Formation, Athena, Redshift, Step Functions, and Lambda.
• Proficiency in Python, with additional expertise in technologies such as React and Node.js within a Backend-for-Frontend architecture preferred.
• Ability to contribute solution concepts and detailed designs within defined architecture standards, delivery patterns, and governance frameworks.
• Understanding of MLOps principles and experience supporting self-service capabilities for data science teams.
• Experience with streaming and messaging technologies such as Kafka or Spark Streaming, along with strong SQL and data modelling skills.
• Interest in or exposure to AI and generative AI technologies is advantageous but not a primary requirement.
• Excellent communication, stakeholder engagement, and coaching abilities.
• Fluent Cantonese and English language skills are required; Mandarin is an advantage.
• Previous experience within a consulting, professional services, or technology services environment is preferred.

What's on Offer

• Competitive monthly salary.
• Usual contractor benefits offered by the organization.

Data Engineer Lead role in Hong Kong