Data Engineer: AI-Powered Pipelines & Scalable DataOps

Thakral One Pte. Ltd.; Kuala Lumpur; On-site; MYR 60,000 - 120,000; Full time

Job summary

Thakral One Pte. Ltd. invites a Data Engineer to design, build, and maintain modular pipelines that support efficient refresh cycles and AI/ML model integration. You will work across teams to deliver scalable, secure data environments and reliable processes.

You will leverage Python, SQL, Airflow, Spark, and Azure/AWS data services to ingest, transform, and govern data assets while optimizing performance and governance practices.

Qualifications

• 3–7 years hands-on data engineering experience.
• Experience designing incremental and modular pipelines.
• Experience integrating APIs and external data sources.

Responsibilities

• Design, develop, and maintain data pipelines using Airflow.
• Build modular data flows to optimise refresh cycles and minimise redundant runs.
• Develop ETL/ELT workflows to ingest and transform data from telecom and operational systems.
• Integrate APIs and external data sources into pipelines.
• Collaborate with cross-functional teams to deploy AI/ML models into production.
• Ensure data governance, versioning, and access management through documentation.
• Troubleshoot and optimise data processes for reliability and performance.

Skills

Python

SQL

Airflow

Spark

Azure Data Factory

AzureML

Synapse

Blob Storage

Azure SQL

AWS S3

ECS

RDS

EC2

Tools

Azure Data Factory

Job description

Thakral One Pte. Ltd. invites a Data Engineer to design, build, and maintain modular pipelines that support efficient refresh cycles and AI/ML model integration. You will work across teams to deliver scalable, secure data environments and reliable processes.

You will leverage Python, SQL, Airflow, Spark, and Azure/AWS data services to ingest, transform, and govern data assets while optimizing performance and governance practices.