Senior Data Engineer - IC

Classy Wheeler Limited; Hong Kong; On-site; HKD 420,000 - 700,000; Full time

Job summary

A major digital solutions provider in Hong Kong is seeking a skilled Data Architect/Engineer to build and manage data infrastructure. The ideal candidate will leverage modern data technologies to develop scalable data solutions and manage a small team of data engineers. Required qualifications include at least 5 years of experience in data warehouse and Big data technologies, strong skills in SQL and Python/Scala, and familiarity with cloud environments. This role offers opportunities to work in a dynamic e-commerce industry.

Qualifications

• At least 5 years of experience in data warehouse, ETL, BI, and Big data areas.
• Experience leading a small team of data engineers is a plus.
• Familiarity with working in digital, e-commerce, and web environments.
• Strong in SQL, Python/Scala.
• Experience working with large, complex and multiple data sets from various sources.
• Expert in data architecture, data modelling and design, data pipeline and data integration.
• Hands‑on experience in using big data components such as Hive, Spark, Presto, Python and Airflow.
• Experience in AWS (EC2, S3, Kinesis/Kafka, Athena, Redshift), Google Cloud or other public cloud environments is a must.
• Experience leading a small team of data engineers is a plus.
• Working experience in the digital, e‑commerce industry, mobile app and web environment is highly desirable.

Responsibilities

• Build best-in-class data infrastructure and engineering solutions.
• Work with cross-functional teams using modern data technologies.
• Manage data lakehouse architecture and self-service tools.
• Develop efficient clean code and improve existing code.
• Lead several data projects.
• Manage and lead several data projects.

Skills

SQL

Python

Scala

Data architecture

Data modelling

Big data technologies

ETL

Big data

Data warehouse

Education

Degree in Computer Science or related discipline

Tools

AWS (EC2, S3, Kinesis/Kafka, Athena, Redshift)

Google Cloud

Hive

Spark

Airflow

Spark

Presto

Airflow

Job description

Major digital and media solutions provider in Hong Kong

Job Description

Candidates with less experience will be considered as Data Engineer.

Responsibilities

• Build up best in class data infrastructure, data engineering solutions.
• Work with cross-functional teams within the organization of different countries, and working with PB size of data, by using modern data technologies (AWS, Databricks, Confluent Kafka, dbt, etc.).
• Leverage industry best practices to build highly flexible, scalable and cost-effective data pipelines and platforms.
• Manage data lakehouse architecture and self-service tools. Ensure that data is highly available and reusable for enabling data science initiatives, analytics and end users to drive business growth.
• Develop efficient clean code, improve existing code for better performance, code review, execute code builds to test and production environments.
• Manage and lead several data projects.

Job Requirements

• To be successful in your new position, it is essential to have the following skills:
• Degree in Computer Science, Information System, Actuarial or related discipline.
• At least 5 years of working experience in data warehouse, ETL, BI, Big data areas and broad exposure to all its sub-disciplines.
• Strong in SQL, Python/Scala.
• Experience working with large, complex and multiple data sets from various sources.
• Expert in data architecture, data modelling and design, data pipeline and data integration.
• Hands‑on experience in using big data components such as Hive, Spark, Presto, Python and Airflow.
• Experience in AWS (EC2, S3, Kinesis/Kafka, Athena, Redshift), Google Cloud or other public cloud environments is a must.
• Experience leading a small team of data engineers is a plus.
• Working experience in the digital, e‑commerce industry, mobile app and web environment is highly desirable.