Senior Cloud Data Engineer: Build ML Pipelines on AWS

InfoConnect Sdn Bhd; Petaling Jaya; On-site; MYR 180,000 - 300,000; Full time

Job summary

InfoConnect Sdn Bhd in Malaysia is seeking a Senior Data Engineer to manage, modernize, and scale our core data infrastructure. You will bridge legacy enterprise data architectures with modern cloud environments, overseeing pipelines across IBM DataStage, SAS ETL, SAP Data Integration, and AWS Glue.

You will build data pipelines and feature stores to support ML and predictive analytics, optimize SQL performance, and collaborate with BI and data governance teams to ensure well-documented,

Qualifications

• 5+ years in Data Engineering, ETL Architecture, and Database Management.
• Hands-on with AWS Glue, PySpark/Spark, and AWS data ecosystems.
• Experience with IBM DataStage, SAS ETL, and SAP Data Integration (BODS/DS).
• Proficient in Python (Pandas, PySpark, Scikit-Learn) for ML data prep and ML pipelines.
• Strong SQL, indexing, schema design (relational, columnar, star schema).
• Nice to have Cognos Analytics or other BI layers; knowledge of data governance.

Responsibilities

• Architect, build, and optimize scalable ETL/ELT pipelines in AWS Glue, Lambda, and Redshift/Athena.
• Maintain and optimize IBM DataStage and SAS ETL jobs; extract from SAP Data Integration environments to cloud platform.
• Design, build, and maintain data pipelines for ML model training, feature stores, and automated scoring.
• Identify bottlenecks, optimize complex SQL queries, and ensure efficient data movement across databases and cloud storage.
• Collaborate with Enterprise BI & Data Governance teams to ensure outputs are well-documented and migration-ready.

Skills

Data engineering

ETL architecture

Database design

Python for ML

SQL optimization

Adaptability

Tools

AWS Glue

PySpark

IBM DataStage

SAS ETL

SAP Data Services

IBM Cognos Analytics

Job description

InfoConnect Sdn Bhd in Malaysia is seeking a Senior Data Engineer to manage, modernize, and scale our core data infrastructure. You will bridge legacy enterprise data architectures with modern cloud environments, overseeing pipelines across IBM DataStage, SAS ETL, SAP Data Integration, and AWS Glue.

You will build data pipelines and feature stores to support ML and predictive analytics, optimize SQL performance, and collaborate with BI and data governance teams to ensure well-documented,