Data Engineer - Autonomous Driving Data Pipelines & AI

ARRK Engineering; Petaling Jaya; On-site; MYR 90,000 - 150,000; Full time

Job summary

ARRK Malaysia Sdn Bhd is seeking a data-driven software engineer to join our autonomous driving data platform team. You will develop scalable data products and pipelines to consolidate, process, and analyze large data sets, and work with stakeholders on AI applications.

The role requires a university degree in a relevant field, strong Python and Apache Spark skills, and experience with Azure, AWS, or Palantir. On-site in Petaling Jaya.

Qualifications

• University degree in Data Engineering, Data Science, Computer Science, Software Engineering, Mathematics, or a comparable field
• Practical experience with cloud platforms such as Azure, AWS, or Palantir (e.g., Databricks, ADX, Glue, Azure Data Factory, Foundry)
• Strong knowledge of data modeling, data engineering, and/or data management
• Experience in data science and/or machine learning
• Excellent Python skills and solid knowledge of Apache Spark
• Experience with containerization and orchestration technologies such as Docker, Kubernetes, or ARGO Workflows is an advantage

Responsibilities

• Develop highly scalable digital products and services for automated consolidation, processing, and analysis of large‑scale data sets
• Design and implement efficient data transformations, pipelines, and ETL processes
• Build data pipelines for cutting-edge AI applications
• Evaluate emerging technologies and industry trends, contributing to architectural decisions and fostering innovative solutions
• Collaborate closely with stakeholders and customers throughout development, deployment, and operations to ensure continuous improvement
• Maintenance and support of the developed software
• Creation of documentation and presentations for the software

Skills

Data engineering

Data science

Python

Apache Spark

Azure

AWS

Palantir Foundry

Docker

Kubernetes

Education

University degree in Data Engineering, Data Science, Computer Science, Software Engineering, Mathematics

Tools

Azure

AWS

Palantir Foundry

Job description

ARRK Malaysia Sdn Bhd is seeking a data-driven software engineer to join our autonomous driving data platform team. You will develop scalable data products and pipelines to consolidate, process, and analyze large data sets, and work with stakeholders on AI applications.

The role requires a university degree in a relevant field, strong Python and Apache Spark skills, and experience with Azure, AWS, or Palantir. On-site in Petaling Jaya.