Data Engineer — Real-Time Pipelines & Data Quality

Pattern; Hong Kong; On-site; HKD 450,000 - 750,000; Full time

Benefits offered by this job

Great benefits

Competitive pay

Insurance

Time off

Job summary

Pattern is seeking a Data Engineer in Hong Kong to design, implement, and maintain real-time data pipelines. You will work on scalable data streams, ensure data quality, and collaborate with cross-functional teams to meet business needs.

The role focuses on modern data architectures using Redshift/Snowflake, Spark, Airflow, and cloud services, with a global impact across Pattern’s APAC operations.

Qualifications

• Bachelor’s or Master’s Degree in Data Science, Data Analytics, Information Management, Computer Science, Information Technology, related field, or equivalent professional experience.
• Experience in data engineering.
• Working with SQL.
• Experience in implementing modern data architecture-based data warehouses.
• Experience working with data warehouses such as Redshift, BigQuery, or Snowflake and understand data architecture design.
• Familiarity with big data tools such as Kafka, Spark, Hadoop.
• Strong scripting experience in Python or similar languages for data pipeline development and automation.
• Experience with data orchestration and ETL tools such as Apache Airflow, AWS Glue, or similar platforms.
• Strong communication and collaboration skills, with the ability to articulate complex technical concepts to both technical and non-technical stakeholders.
• Expertise with data systems working with massive data sets from various data sources.
• Proficiency in reading and writing English is essential.

Responsibilities

• Develop, deploy, and support real-time, automated, scalable data streams from a variety of sources into the data lake or data warehouse.
• Develop and implement data auditing strategies and processes to ensure data quality; identify and resolve problems associated with large scale data processing workflows; implement technical solutions to maintain data pipeline processes and troubleshoot failures.
• Collaborate with technology teams and partners to specify data requirements and provide access to data.
• Tune application and query performance using profiling tools and SQL or other relevant query language.
• Understand business, operations, and analytics requirements for data.
• Build data expertise and own data quality for assigned areas of ownership.
• Work with data infrastructure to triage issues and drive to resolution.

Skills

SQL

Python

Data modeling

Communication

Education

Bachelor’s or Master’s Degree in Data Science / related field

Tools

Redshift

BigQuery

Snowflake

Kafka

Spark

Hadoop

Airflow

AWS Glue

S3

Lambda

Job description

Pattern is seeking a Data Engineer in Hong Kong to design, implement, and maintain real-time data pipelines. You will work on scalable data streams, ensure data quality, and collaborate with cross-functional teams to meet business needs.

The role focuses on modern data architectures using Redshift/Snowflake, Spark, Airflow, and cloud services, with a global impact across Pattern’s APAC operations.