Data Platform Architect

iSoftStone; Kuala Lumpur; Hybrid; MYR 120,000 - 180,000; Full time

Benefits offered by this job

Travel reimbursement

Job summary

iSoftStone is seeking a data engineer in Malaysia to design, develop, and maintain enterprise-level data warehouse models and ETL pipelines. You will work across ODS, DWD, DWS, and ADS and optimize large-scale ETL/ELT processes using Hive, Spark, Flink, HDFS, and Kafka.

Collaborate with Data Analysts, Product Managers, and BI Engineers to deliver reports and dashboards, and participate in data governance initiatives. Travel to client sites will be required during project implementation phases.

Qualifications

• Bachelor's degree or above in Computer Science, Data Engineering or related field.
• Minimum 4 years of relevant working experience in data engineering or data warehouse development.
• Strong command of English and Mandarin with good communication and writing skills.
• Hands-on experience with cloud-native technologies including Kubernetes (K8s), Docker, Jaeger, SkyWalking, and Harbor.
• Experience with Public Cloud (AWS, Azure, GCP) or Private Cloud (Alibaba Cloud) services such as ACK and EDAS.
• Solid understanding of enterprise data platform or data warehouse architecture, with experience designing or implementing a data warehouse from scratch (0→1).
• Hands-on experience with ETL orchestration tools such as Kettle (Pentaho Data Integration) and Apache Airflow.
• Familiar with Alibaba Cloud Data Platform products such as Max Compute (ODPS) and Data Transmission Service (DTS).
• Strong SQL programming skills and scripting experience using Python and Shell.
• Experience with large-scale distributed data processing technologies is highly desirable.
• Excellent analytical, problem-solving, and cross-functional collaboration skills.

Responsibilities

• Design, develop, and maintain enterprise-level data warehouse models, ETL pipelines, and scheduling workflows to ensure data accuracy, consistency, and timelines.
• Analyze business requirements, identify data sources, and design end-to-end data processing workflows across the data warehouse layers, including ODS, DWD, DWS, and ADS.
• Develop and optimize large-scale ETL/ELT processes using big data technologies such as Hive, Spark, Flink, HDFS, and Kafka for data extraction, cleansing, transformation, and loading.
• Write efficient, maintainable SQL queries and scripts (e.g. Python and Shell) to improve data processing performance and execution efficiency.
• Collaborate closely with Data Analysts, Product Managers, and BI Engineers to support reporting, dashboards, and analytical requirements.
• Develop data visualizations using BI tools such as Tableau, Power BI, FineBI, or QuickBI to support business decision-making.
• Participate in data governance initiatives, including metadata management, data quality monitoring, and data lineage analysis.

Skills

English

Mandarin

Education

Bachelor's degree in Computer Science or Data-related field

Tools

Kubernetes (K8s)

Docker

Jaeger

SkyWalking

Harbor

AWS

Azure

GCP

Alibaba Cloud

Kettle (Pentaho)

Apache Airflow

Max Compute (ODPS)

DTS

Job description

A global technology company specializing in e-commerce, cloud computing, digital payments, logistics, and artificial intelligence, serving businesses and consumers across more than 200 countries and regions.

• Design, develop, and maintain enterprise-level data warehouse models, ETL pipelines, and scheduling workflows to ensure data accuracy, consistency, and timelines
• Analyze business requirements, identify data sources, and design end-to-end data processing workflows across the data warehouse layers, including ODS, DWD, DWS, and ADS
• Develop and optimize large-scale ETL/ELT processes using big data technologies such as Hive, Spark, Flink, HDFS, and Kafka for data extraction, cleansing, transformation, and loading
• Write efficient, maintainable SQL queries and scripts (e.g. Python and Shell) to improve data processing performance and execution efficiency
• Collaborate closely with Data Analysts, Product Managers, and BI Engineers to support reporting, dashboards, and analytical requirements
• Develop data visualizations using BI tools such as Tableau, Power BI, FineBI, or QuickBI to support business decision-making
• Participate in data governance initiatives, including metadata management, data quality monitoring, and data lineage analysis

Job Requirements:

• Bachelor's degree or above in Computer Science, Data Engineering, Data Science or a related courses
• Minimum 4 years of relevant working experience in data engineering or data warehouse development
• Strong command of both English and Chinese Mandarin languages with good communication and writing skills
• Hands-on experience with cloud-native technologies, including Kubernetes (K8s), Docker, Jaeger, SkyWalking, and Harbor
• Experience with Public Cloud (AWS, Azure, GCP) or Private Cloud (Alibaba Cloud) services such asACK and EDAS is highly preferred
• Solid understanding of enterprise data platform or data warehouse architecture, with experience participating in the design or implementation of a data warehouse from scratch (0→1)
• Hands-on experience with ETL orchestration tools such as Kettle (Pentaho Data Integration) and Apache Airflow.
• Familiar with Alibaba Cloud Data Platform products suchas Max Compute (ODPS) and Data Transmission Service (DTS) is an advantage
• Strong SQL programming skills and scripting experience using Python and Shell
• Experience working with large-scale distributed data processing technologies is highly desirable
• Excellent analytical, problem-solving, and cross-functional collaboration skills

Working Arrangement :

• First 2–3 months (Project Implementation Phase): Required to travel to Tanjung Malim (client's office) every working day.
• Daily travel is required until the data platform project is deployed.
• After project deployment (estimated after 2–3 months of onboarding): Required to work at the Tanjung Malim (client's office) for a maximum of 2 days per week.
• Remaining working days will be based at either: iSoftStone's Setia Alam Office, or Intermark KL Office (TBC).
• Travel Reimbursement: Mileage, petrol, and toll expenses incurred for work-related travel to Tanjung Malim will be reimbursed.