Data Engineer: AI-Driven Pipelines & LLM Apps

Asian Pac Holdings Bhd; Kuala Lumpur; On-site; MYR 120,000 - 180,000; Full time

Benefits offered by this job

Medical Comprehensive Insurance

Job summary

ASIAN PAC Holdings Berhad is seeking a Data Engineer to design, implement, and optimize data infrastructure powering data-driven initiatives. The role emphasizes building scalable data pipelines, AI agent solutions, and RAG-grounded LLM workflows across Azure and AWS environments.

You will collaborate with data scientists, analysts, and business stakeholders to ensure reliable, scalable data assets and facilitate cross-functional decision-making in a fast-paced setting.

Qualifications

• Bachelor's or Master's degree in Data Science, Computer Science, Engineering, or a related field.
• Proven experience as a Data Engineer or similar, with data engineering concepts and best practices.
• Hands-on experience with Azure and/or AWS data pipelines (Azure Data Factory, Databricks; AWS Glue, Redshift).
• Proficiency in Python, Java, or Scala and data processing frameworks (Spark, Hadoop).
• Experience with Airflow/D Dagster/Prefect for orchestration.
• Knowledge of data modelling, warehousing, and databases.
• Familiarity with Agentic AI concepts (LLMs, RAG, LangChain).
• Excellent problem-solving and cross-functional collaboration skills.

Responsibilities

• Design, develop, and maintain robust data pipelines and data lake/data warehouse architecture.
• Develop and maintain Airflow DAGs for orchestration and monitoring of pipelines.
• Collaborate with analysts to implement data transformations and aggregations.
• Research data sources and assess value for property development datasets.
• Create web-scraping scripts to collect open data.
• Build CI/CD pipelines for data pipelines and infrastructure.
• Leverage Azure and AWS services for data solutions.
• Monitor and optimize pipelines for performance and reliability.
• Design AI agent solutions using CrewAI or LangChain ecosystems.
• Build RAG pipelines to ground LLM outputs in company data.

Skills

Python

Java

Scala

Education

Bachelor's degree in Data Science

Master's degree in CS/Engineering

Tools

Azure Data Factory

Azure Databricks

AWS Glue

Amazon Redshift

Job description

ASIAN PAC Holdings Berhad is seeking a Data Engineer to design, implement, and optimize data infrastructure powering data-driven initiatives. The role emphasizes building scalable data pipelines, AI agent solutions, and RAG-grounded LLM workflows across Azure and AWS environments.

You will collaborate with data scientists, analysts, and business stakeholders to ensure reliable, scalable data assets and facilitate cross-functional decision-making in a fast-paced setting.