Data Engineer: Build Scalable Data Pipelines & Insights

Data Engineer - Data Services Data Engineer - Data Services Technology-CIOHong Kong (SAR)Permanent -; Hong Kong; On-site; HKD 420,000 - 640,000; Full time

Job summary

Mox is seeking a Data Engineer to design, maintain, and improve analytical and operational services and infrastructure, including the data lake, data pipelines, and large-scale batch and real-time processing systems. You will work with the data science team to structure data schemas and models, and collaborate with product teams to integrate new sources.

You will be part of a data-driven organization focused on secure, scalable data infrastructure, leveraging cloud services and modern

Qualifications

• Design, maintain and improve analytical and operational services and infrastructure.

Responsibilities

• Design, maintain and improve data infrastructure used across the company.
• Develop data pipelines for batch and real-time processing.
• Collaborate with data science to structure data schemas and models, and integrate new sources.

Skills

Unix environments

Python

Workflow orchestration

Big data concepts

AWS basics

Agile/Lean

Tools

Apache Airflow

Luigi

AWS Batch

Kafka

Pulsar

RabbitMQ

Google Pub/Sub

Docker

Kubernetes

Hive/Hadoop

Spark

Sagemaker

Databricks

Job description

Mox is seeking a Data Engineer to design, maintain, and improve analytical and operational services and infrastructure, including the data lake, data pipelines, and large-scale batch and real-time processing systems. You will work with the data science team to structure data schemas and models, and collaborate with product teams to integrate new sources.

You will be part of a data-driven organization focused on secure, scalable data infrastructure, leveraging cloud services and modern