Senior Data Engineer: PySpark, AWS ETL & Data Lakes

Global Sports Jobs Limited; Hong Kong; Sur place; HKD 800 000 - 1 400 000; Plein temps

Avantages offerts par ce poste

Competitive benefits package

Dynamic working environment

Development opportunities

Résumé du poste

The Hong Kong Jockey Club is seeking an experienced Data Engineer to shape the organisation's digital future within the AOP programme. You will design, build, and operate scalable ETL/ELT data pipelines using PySpark and SQL on AWS, implement a cloud data lake, and optimise data flows for performance and cost.

You will work with business users and product owners to ensure the delivery of reliable analytics capabilities, real-time data streams, and compliant data governance across on-prem and

Qualifications

• Proven expertise in PySpark for large-scale data processing.
• Strong experience building and managing production-level ETL/ELT workflows.
• Hands-on experience with AWS or other cloud data analytics services.
• Hands-on experience with data visualisation tools such as Power BI or Tableau.
• 5–8 years of hands-on experience in data engineering and scalable cloud pipelines.
• 3+ years of experience with end-to-end data pipeline lifecycle management, including monitoring.
• Experience architecting and managing cloud data platforms on AWS.
• Knowledge of data governance and security best practices.

Responsabilités

• Design, develop, test, and operationalise ETL/ELT data pipelines using PySpark and SQL on AWS.
• Implement and manage a cloud data lake and orchestrate data flows following medallion architecture.
• Optimise pipelines and storage for performance, cost, and reliability with large data volumes.
• Communicate with business users and product owners as required.

Connaissances

PySpark

SQL

ETL/ELT design

AWS

Data governance

Data modelling

CI/CD

Observability

Outils

Power BI

Tableau

Terraform

CloudFormation

Kafka

Solace

Git

Description du poste

The Hong Kong Jockey Club is seeking an experienced Data Engineer to shape the organisation's digital future within the AOP programme. You will design, build, and operate scalable ETL/ELT data pipelines using PySpark and SQL on AWS, implement a cloud data lake, and optimise data flows for performance and cost.

You will work with business users and product owners to ensure the delivery of reliable analytics capabilities, real-time data streams, and compliant data governance across on-prem and