Senior Data Engineer(Snowflake / PostgreSQL)

北京汉克时代科技有限公司; Kuala Lumpur; On-site; MYR 120,000 - 180,000; Full time

Job summary

北京汉克时代科技有限公司 is hiring a data platform engineer to build and run an enterprise data platform. You will design batch and streaming ingestion, manage Snowflake models, and expose data via RESTful interfaces. The role requires strong SQL, Python, and collaboration across regional teams in English or Chinese.

You will work with technologies like NiFi, Kafka, Flink, Airflow, dbt and Power BI, while ensuring security, governance and monitoring across the stack.

Qualifications

• 2+ years hands-on Snowflake experience with warehouses and data sharing
• Strong PostgreSQL indexing and query optimization
• Advanced SQL and data modeling
• 3+ years data integration or security/compliance knowledge (GDPR/PDPA/PIPL) preferred
• Proficient in Python; Git and CI/CD practice
• Excellent communication; able to collaborate with cross-regional teams in English or Chinese
• Bachelor's degree or above in CS or data-related field

Responsibilities

• Design and build batch and real-time data ingestion pipelines using NiFi, Kafka, Events Hub and Flink
• Own Snowflake layered modeling and optimize performance and cost
• Own PostgreSQL schema design and expose data via PostgREST and APIM
• Build scheduling and transformations with Airflow and dbt; implement CI/CD via Azure DevOps
• Ensure data security and compliance: RBAC, masking, encryption, auditing, classification
• Maintain metadata, lineage and data quality via Atlan; set up monitoring with Splunk and Grafana
• Support downstream consumers (Power BI) and collaborate with analysts and BI teams

Skills

Python

SQL

Data Modeling

ETL/ELT

Education

Bachelor's degree in CS or related field

Tools

Snowflake

PostgreSQL

NiFi

Kafka

Flink

Airflow

dbt

Astronomer

Azure DevOps

APIM

Power BI

Atlan

Splunk

Grafana

Job description

About the Role
Build and operate an enterprise data platform covering ingestion, storage, modeling, orchestration and data serving — ensuring reliability, security and compliance.

Responsibilities

Design and build batch and real-time data ingestion pipelines (CDC, database, HTTP/TCP, push sources) using NiFi, Kafka, Events Hub and Flink.

Own Snowflake layered modeling (Landing, Current State, Business layers), performance tuning and cost control.

Own PostgreSQL schema design, performance optimization and operations; expose data via PostgREST and APIM.

Build scheduling and transformation workflows with Airflow (Astronomer) and dbt; implement CI/CD via Azure DevOps.

Implement data security and compliance: RBAC, data masking, encryption, access auditing, data classification and retention.

Maintain metadata, lineage and data quality via Atlan; set up monitoring and alerting with Splunk and Grafana.

Support downstream consumers (e.g. Power BI) and work with analysts, BI developers and business teams.

Requirements (meet either track)

Track A – Databases & Warehousing: 2+ years hands-on Snowflake (virtual warehouses, access model, data sharing, performance/cost optimization); strong PostgreSQL (indexing, execution plans, partitioning, replication, backup/recovery); advanced SQL and data modeling.

Track B – Integration & Security Compliance: 3+ years data integration (CDC, batch/stream, NiFi/Kafka/Flink or similar); hands-on data security and compliance (RBAC, masking, encryption, auditing, classification) and knowledge of relevant regulations (GDPR, PDPA, PIPL); able to translate compliance requirements into technical controls.

General

Bachelor's degree or above, preferably in Computer Science or a data-related field.

Proficient in Python or another programming language; Git and CI/CD practice.

Strong communication skills; able to collaborate with cross-regional teams in Chinese or English.

Nice to Have

Airflow, dbt, Astronomer.

Azure cloud services (Events Hub, APIM, DevOps).

Atlan or similar data catalog; data quality and lineage management.

Splunk and Grafana.

Power BI integration or REST API data services.

Snowflake, Azure or security certifications.

Ingestion: NiFi, Kafka Connector, Events Hub, Flink

Application & Presentation: APIM, Atlan, Power BI

Monitoring: Splunk, Grafana