Data Engineer: Python, Spark on AWS EMR + ML Ops

Michael Page International (HK) Ltd; Hong Kong; On-site; HKD 472,000 - 525,000; Full time

Benefits offered by this job

Competitive monthly salary.

Access to usual benefits provided by.

Job summary

Michael Page International (HK) Ltd in Hong Kong is seeking a Data Engineer to design, develop, and maintain scalable data pipelines on a cloud-based platform. You will optimize Spark workloads on AWS EMR for both batch and real-time processing and enable self-service analytics with high-quality, governed datasets.

The role requires 3–5 years in data engineering, strong Python and SQL skills, plus experience with S3, Glue, Athena, Redshift, and Lambda.

Qualifications

• 3-5 years hands-on data engineering experience.
• Strong Spark on AWS EMR experience.
• Experience with AWS data services: S3, Glue, Athena, Redshift, Step Functions, Lambda; Lake Formation/SageMaker exposure is advantageous.
• Proficiency in Python and advanced SQL; ETL/ELT development and data modelling.
• Familiarity with Hive, Presto, Kafka, Spark Streaming.
• Knowledge of MLOps and production ML models.
• Exposure to AI/Generative AI projects an advantage.
• Strong collaboration and communication skills.
• Fluent in Cantonese and English; Mandarin a plus.
• Experience in IT consulting or technology services preferred.

Responsibilities

• Design, develop, and maintain scalable data pipelines and data products within a cloud-based data platform.
• Build, enhance, and troubleshoot Apache Spark workloads on AWS EMR for batch and real-time processing.
• Enable self-service analytics with governed, high-quality datasets.
• Contribute to MLOps processes, including model deployment, monitoring, and data prep for production ML solutions.
• Support AI and Generative AI initiatives by delivering data foundations and platform integrations.
• Maintain data quality, governance, lineage, security, and end-to-end lifecycle.
• Collaborate with business users and platform teams to gather requirements and implement data-driven solutions.
• Adhere to architecture guidelines and development standards.

Job description

Michael Page International (HK) Ltd in Hong Kong is seeking a Data Engineer to design, develop, and maintain scalable data pipelines on a cloud-based platform. You will optimize Spark workloads on AWS EMR for both batch and real-time processing and enable self-service analytics with high-quality, governed datasets.

The role requires 3–5 years in data engineering, strong Python and SQL skills, plus experience with S3, Glue, Athena, Redshift, and Lambda.