Data Engineer (Python Backend, IT)47k

Michael Page International (HK) Ltd; Hong Kong; On-site; HKD 472,000 - 525,000; Full time

Benefits offered by this job

Competitive monthly salary.

Access to usual benefits provided by.

Job summary

Michael Page International (HK) Ltd in Hong Kong is seeking a Data Engineer to design, develop, and maintain scalable data pipelines on a cloud-based platform. You will optimize Spark workloads on AWS EMR for both batch and real-time processing and enable self-service analytics with high-quality, governed datasets.

The role requires 3–5 years in data engineering, strong Python and SQL skills, plus experience with S3, Glue, Athena, Redshift, and Lambda.

Qualifications

• 3-5 years hands-on data engineering experience.
• Strong Spark on AWS EMR experience.
• Experience with AWS data services: S3, Glue, Athena, Redshift, Step Functions, Lambda; Lake Formation/SageMaker exposure is advantageous.
• Proficiency in Python and advanced SQL; ETL/ELT development and data modelling.
• Familiarity with Hive, Presto, Kafka, Spark Streaming.
• Knowledge of MLOps and production ML models.
• Exposure to AI/Generative AI projects an advantage.
• Strong collaboration and communication skills.
• Fluent in Cantonese and English; Mandarin a plus.
• Experience in IT consulting or technology services preferred.

Responsibilities

• Design, develop, and maintain scalable data pipelines and data products within a cloud-based data platform.
• Build, enhance, and troubleshoot Apache Spark workloads on AWS EMR for batch and real-time processing.
• Enable self-service analytics with governed, high-quality datasets.
• Contribute to MLOps processes, including model deployment, monitoring, and data prep for production ML solutions.
• Support AI and Generative AI initiatives by delivering data foundations and platform integrations.
• Maintain data quality, governance, lineage, security, and end-to-end lifecycle.
• Collaborate with business users and platform teams to gather requirements and implement data-driven solutions.
• Adhere to architecture guidelines and development standards.

Job description

$42300 - $47k p.m. + Medical+10%Gratuity

Description

• Design, develop, and maintain scalable data pipelines and data products within a cloud-based data platform.
• Build, enhance, and troubleshoot Apache Spark workloads on AWS EMR for both batch and real-time data processing.
• Enable self-service analytics and data science capabilities through well-structured, governed, and high-quality datasets.
• Contribute to MLOps processes, including support for model deployment, monitoring, and data preparation activities for production ML solutions.
• Assist with AI and Generative AI initiatives by delivering the necessary data foundations and platform integrations.
• Maintain data quality, governance, lineage, security, and consistency across the end-to-end data lifecycle.
• Collaborate with business users, data specialists, and platform engineering teams to gather requirements and implement data-driven solutions.
• Adhere to established architecture guidelines, engineering best practices, and development standards.

Profile

• 3-5 years of hands-on experience in data engineering.
• Strong practical experience with Apache Spark running on AWS EMR.
• Experience working with AWS data services, including S3, Glue, Athena, Redshift, Step Functions, and Lambda; exposure to Lake Formation and SageMaker is advantageous.
• Proficiency in Python and advanced SQL, with experience in ETL/ELT development and data modelling.
• Familiarity with big data and streaming technologies such as Hive, Presto, Kafka, and Spark Streaming.
• Knowledge of MLOps principles and experience supporting machine learning models in production environments is beneficial.
• Exposure to AI and Generative AI-related projects is an advantage.
• Strong collaboration skills and effective communication abilities.
• Fluent in Cantonese and English; Mandarin proficiency is a plus.
• Prior experience gained within an IT consulting environment or technology services organisation is preferred.

Job Offer

• Competitive monthly salary.
• Access to the usual benefits provided by the employer.