Senior Data Engineer

北京汉克时代科技有限公司; Kuala Lumpur; On-site; MYR 90,000 - 150,000; Full time

Benefits offered by this job

Remuneration package

Flexible working arrangement

Regional data projects

Job summary

北京汉克时代科技有限公司 is hiring for a Data Platform Engineer to build, operate, and maintain an enterprise data platform across ingestion, modelling, transformation, and API delivery. The role includes ensuring platform stability, performance tuning, and cloud cost governance while adhering to regional data privacy regulations.

The position offers two tracks: Track A for Data Warehouse & Database, and Track B for Data Integration & Data Security Compliance.

Qualifications

• Bachelor's degree in Computer Science, Information Technology or related discipline.
• 3+ years Snowflake experience: virtual warehouse setup, permission model, data sharing, performance tuning and cost optimisation
• Strong PostgreSQL skills: index tuning, execution plan analysis, table partitioning, replication, backup & disaster recovery
• Advanced SQL skills, practical experience with dimensional modelling or layered data warehouse modelling

Responsibilities

• Design and develop multi-source data ingestion pipelines using NiFi, Kafka Connector, Events Hub, Flink for batch and real-time data integration
• Build Snowflake layered data warehouse modelling (Landing / Current State / Business layer), conduct performance tuning and cost governance
• Design, optimise and maintain PostgreSQL databases; expose data APIs via PostgREST + APIM for downstream teams
• Develop and schedule data transformation pipelines with Airflow (Astronomer) & dbt; implement CI/CD workflow on Azure DevOps
• Deliver data security & compliance controls: RBAC permission management, data masking, encryption, access audit, data classification and retention policy
• Maintain metadata, data lineage and data quality rules via Atlan; build monitoring & alerting dashboards with Splunk and Grafana
• Collaborate with analysts, BI developers and business stakeholders, support downstream systems including Power BI and troubleshoot data issues

Skills

Python

SQL

Git

CI/CD

English Mandarin

Education

Bachelor's degree in Computer Science/IT

Tools

NiFi

Kafka

Flink

Airflow

dbt

PostgREST

Grafana

Azure DevOps

Snowflake

Job description

Important Notice: This role has TWO tracks. You only need to meet ONE track’s criteria to apply. Please clearly state Track A or Track B in your application.

Track A: Data Warehouse & Database

Track B: Data Integration & Data Security Compliance

About the Role

You will build, operate and maintain our enterprise data platform, covering end-to-end workflow: data ingestion, data modelling, data transformation, API service delivery, monitoring and data governance. You are responsible for platform stability, query performance, cloud cost control and adherence to regional data privacy regulations.

Key Responsibilities

Design and develop multi-source data ingestion pipelines (CDC, direct database connection, HTTP/TCP, push feed) using NiFi, Kafka Connector, Events Hub, Flink for batch and real-time data integration

Build Snowflake layered data warehouse modelling (Landing / Current State / Business layer), conduct performance tuning and cost governance

Design, optimise and maintain PostgreSQL databases; expose data APIs via PostgREST + APIM for downstream teams

Develop and schedule data transformation pipelines with Airflow (Astronomer) & dbt; implement CI/CD workflow on Azure DevOps

Deliver data security & compliance controls: RBAC permission management, data masking, encryption, access audit, data classification and retention policy, support external & internal compliance audits

Maintain metadata, data lineage and data quality rules via Atlan; build monitoring & alerting dashboards with Splunk and Grafana

Collaborate with analysts, BI developers and business stakeholders, support downstream systems including Power BI and troubleshoot data issues

Job Requirements

You may apply for EITHER Track A OR Track B, satisfy only one track.

Track A: Data Warehouse & Database

Bachelor's degree in Computer Science, Information Technology or related discipline

3+ years hands-on Snowflake experience: virtual warehouse setup, permission model, data sharing, performance tuning and cost optimisation

Strong PostgreSQL skills: index tuning, execution plan analysis, table partitioning, replication, backup & disaster recovery

Advanced SQL skills, practical experience with dimensional modelling or layered data warehouse modelling

Track B: Data Integration & Data Security Compliance

Bachelor's degree in Computer Science, Information Technology or related discipline

3+ years data integration experience, familiar with CDC, stream & batch processing; hands-on experience with NiFi / Kafka / Flink or equivalent tools

Proven experience implementing data security controls: RBAC, data masking, encryption, access audit and data classification

Familiar with data protection laws including PDPA, GDPR; able to translate compliance requirements into technical controls and pass audits

Mandatory Common Requirements (for both tracks)

Proficient in Python or other programming language

Practical hands-on experience with Git and CI/CD pipelines

Able to communicate and collaborate cross-region in English OR Mandarin

Preferred Skills (Bonus)

What We Offer

• Attractive remuneration package
• Flexible working arrangement
• Exposure to regional cross-border enterprise data projects

We provide end-to-end IT consulting, integration, software development, EIV/ODC projects, maintenance, testing, and staffing. Serving key industries worldwide, we deliver large-scale solutions from Beijing.

We provide end-to-end IT consulting, integration, software development, EIV/ODC projects, maintenance, testing, and staffing. Serving key industries worldwide, we deliver large-scale solutions from Beijing.