Senior Data Platform Architect - Big Data, Cloud & ETL

iSoftStone; Kuala Lumpur; Hybrid; MYR 120,000 - 180,000; Full time

Benefits offered by this job

Travel reimbursement

Job summary

iSoftStone is seeking a data engineer in Malaysia to design, develop, and maintain enterprise-level data warehouse models and ETL pipelines. You will work across ODS, DWD, DWS, and ADS and optimize large-scale ETL/ELT processes using Hive, Spark, Flink, HDFS, and Kafka.

Collaborate with Data Analysts, Product Managers, and BI Engineers to deliver reports and dashboards, and participate in data governance initiatives. Travel to client sites will be required during project implementation phases.

Qualifications

• Bachelor's degree or above in Computer Science, Data Engineering or related field.
• Minimum 4 years of relevant working experience in data engineering or data warehouse development.
• Strong command of English and Mandarin with good communication and writing skills.
• Hands-on experience with cloud-native technologies including Kubernetes (K8s), Docker, Jaeger, SkyWalking, and Harbor.
• Experience with Public Cloud (AWS, Azure, GCP) or Private Cloud (Alibaba Cloud) services such as ACK and EDAS.
• Solid understanding of enterprise data platform or data warehouse architecture, with experience designing or implementing a data warehouse from scratch (0→1).
• Hands-on experience with ETL orchestration tools such as Kettle (Pentaho Data Integration) and Apache Airflow.
• Familiar with Alibaba Cloud Data Platform products such as Max Compute (ODPS) and Data Transmission Service (DTS).
• Strong SQL programming skills and scripting experience using Python and Shell.
• Experience with large-scale distributed data processing technologies is highly desirable.
• Excellent analytical, problem-solving, and cross-functional collaboration skills.

Responsibilities

• Design, develop, and maintain enterprise-level data warehouse models, ETL pipelines, and scheduling workflows to ensure data accuracy, consistency, and timelines.
• Analyze business requirements, identify data sources, and design end-to-end data processing workflows across the data warehouse layers, including ODS, DWD, DWS, and ADS.
• Develop and optimize large-scale ETL/ELT processes using big data technologies such as Hive, Spark, Flink, HDFS, and Kafka for data extraction, cleansing, transformation, and loading.
• Write efficient, maintainable SQL queries and scripts (e.g. Python and Shell) to improve data processing performance and execution efficiency.
• Collaborate closely with Data Analysts, Product Managers, and BI Engineers to support reporting, dashboards, and analytical requirements.
• Develop data visualizations using BI tools such as Tableau, Power BI, FineBI, or QuickBI to support business decision-making.
• Participate in data governance initiatives, including metadata management, data quality monitoring, and data lineage analysis.

Skills

English

Mandarin

Education

Bachelor's degree in Computer Science or Data-related field

Tools

Kubernetes (K8s)

Docker

Jaeger

SkyWalking

Harbor

AWS

Azure

GCP

Alibaba Cloud

Kettle (Pentaho)

Apache Airflow

Max Compute (ODPS)

DTS

Job description

iSoftStone is seeking a data engineer in Malaysia to design, develop, and maintain enterprise-level data warehouse models and ETL pipelines. You will work across ODS, DWD, DWS, and ADS and optimize large-scale ETL/ELT processes using Hive, Spark, Flink, HDFS, and Kafka.

Collaborate with Data Analysts, Product Managers, and BI Engineers to deliver reports and dashboards, and participate in data governance initiatives. Travel to client sites will be required during project implementation phases.