Data Engineer: AI-Driven Pipelines & Cloud Data Mastery

Thakral One Pte. Ltd.; Kuala Lumpur; On-site; MYR 120,000 - 180,000; Full time

Job summary

Thakral One Pte. Ltd. is seeking a Data Engineer to design, build, and maintain modular data pipelines that support efficient refresh cycles and can integrate AI/ML models. You will collaborate with cross-functional teams to deliver reliable, scalable data solutions for business and operational needs.

The role emphasizes Python, SQL, Airflow, and experience with Azure and AWS data ecosystems, ensuring data quality, governance, and performance across production environments.

Qualifications

• 3–7 years of hands-on experience in data engineering or related roles.
• Experience designing incremental and modular pipelines.
• Experience integrating APIs and external data sources.

Responsibilities

• Design, develop, and maintain pipelines using Airflow.
• Build modular and incremental data flows to optimise refresh cycles and minimise redundant runs.
• Develop ETL/ELT workflows to ingest and transform data from telecom and operational systems.
• Integrate APIs and external data sources into pipelines.
• Collaborate with cross‑functional teams to integrate AI/ML models into production environments.
• Ensure data quality, version control, and governance through documentation and reusable components.
• Contribute to domain logic validation with business and analytics teams.
• Participate in troubleshooting and optimisation of data processes.
• Ensure reliability, scalability, and performance of data workflows.
• Implement best practices for access management and governance.

Skills

Python

SQL

Airflow

Spark

APIs integration

Data governance

Azure cloud

AWS cloud

Tools

Airflow

Spark

Azure Data Factory

AzureML

Synapse

Blob Storage

Azure SQL

AWS S3

AWS ECS

AWS RDS

AWS EC2

Job description

Thakral One Pte. Ltd. is seeking a Data Engineer to design, build, and maintain modular data pipelines that support efficient refresh cycles and can integrate AI/ML models. You will collaborate with cross-functional teams to deliver reliable, scalable data solutions for business and operational needs.

The role emphasizes Python, SQL, Airflow, and experience with Azure and AWS data ecosystems, ensuring data quality, governance, and performance across production environments.