Cloud Data Engineer (AWS & Azure) - AI/ML Pipelines

Thakral One; Kuala Lumpur; On-site; MYR 60,000 - 90,000; Full time

Job summary

A consulting and technology services firm is looking for Data Engineers to support a major digital transformation in Kuala Lumpur. Candidates will be responsible for building scalable data pipelines in AWS and Azure environments, integrating master data across complex systems for analytics and AI/ML applications. The ideal candidate should have a degree in Computer Science or related fields, proficiency in Python, SQL, and data pipeline tools, and 3-7 years of relevant experience. This is a contract position requiring onsite work.

Qualifications

• 3-7 years of hands-on experience in data engineering or related technical roles.
• Strong proficiency in Python and SQL, with hands-on experience in Airflow and Spark.
• Working knowledge of Azure data ecosystem (Data Factory, AzureML, Synapse, Blob Storage, Azure SQL).
• Familiarity with AWS data tools (S3, ECS, RDS, EC2).
• Experience designing incremental, modular data pipelines and integrating APIs/external data sources.
• Understanding of data governance, version control, and access management practices.
• Excellent analytical, problem-solving, and communication skills.

Responsibilities

• Design, develop, and maintain data pipelines using Airflow and modern orchestration tools.
• Build modular, incremental data flows to support efficient refresh cycles and minimize redundant processing.
• Collaborate with cross-functional teams to integrate AI/ML models into production-grade environments.
• Develop ETL/ELT workflows to ingest and transform data from multiple telecom and operational systems.
• Implement data quality, version control, and governance frameworks with reusable, documented components.
• Conduct troubleshooting, optimization, and performance tuning of data processes to ensure reliability and scalability.
• Partner with business and analytics teams to validate domain logic and ensure accurate data interpretation.

Skills

Data pipeline development (Airflow, Azure Data Factory, Spark)

SQL and Python programming

AWS and/or Azure data platforms

ETL/ELT design, data modeling, data governance

API integrations and modular pipeline design

Education

Bachelor's degree in Computer Science, Information Technology, or Data Engineering

Certifications in Azure Data Engineering, AWS Data Analytics, or GCP Data Engineering

Tools

Airflow

Spark

Azure Data Factory

Docker

Kubernetes

Job description

A consulting and technology services firm is looking for Data Engineers to support a major digital transformation in Kuala Lumpur. Candidates will be responsible for building scalable data pipelines in AWS and Azure environments, integrating master data across complex systems for analytics and AI/ML applications. The ideal candidate should have a degree in Computer Science or related fields, proficiency in Python, SQL, and data pipeline tools, and 3-7 years of relevant experience. This is a contract position requiring onsite work.