Data Engineer for Autonomous Driving AI Pipelines

ARRK Asia; Kuala Lumpur; On-site; MYR 90,000 - 150,000; Full time

Job summary

ARRK Engineering, part of the ARRK group, offers an interdisciplinary environment for autonomous driving data-driven software projects. You will develop scalable data products, build ETL pipelines, and contribute to AI-driven solutions while collaborating with stakeholders across the project lifecycle.

The role focuses on data engineering, cloud platforms, and ML capabilities, with opportunities to influence architecture and document technical decisions.

Qualifications

• University degree in Data Engineering, Data Science, CS, SE, Mathematics or similar.
• Experience with cloud platforms such as Azure, AWS, or Palantir Foundry/Databricks/ADX/Glue/Azure Data Factory.
• Strong data modeling, data engineering or data management knowledge.
• Experience in data science and/or machine learning.
• Excellent Python skills and solid Apache Spark knowledge.
• Experience with containerization/orchestration (Docker, Kubernetes, ARGO Workflows) is a plus.

Responsibilities

• Develop highly scalable digital products and services for automated consolidation, processing, and analysis of large-scale data sets
• Design and implement efficient data transformations, pipelines, and ETL processes
• Build data pipelines for cutting-edge AI applications
• Evaluate emerging technologies and industry trends, contributing to architectural decisions and fostering innovative solutions
• Collaborate closely with stakeholders and customers throughout development, deployment, and operations to ensure continuous improvement
• Maintenance and support of the developed software
• Creation of documentation and presentations for the software

Skills

Python

Apache Spark

Data modeling

Data engineering

Data science

Machine learning

Education

University degree in Data Engineering, Data Science, Computer Science, Software Engineering, Mathematics

Tools

Docker

Kubernetes

ARGO Workflows

Databricks

Foundry

Azure Data Factory

Glue

ADX

Job description

ARRK Engineering, part of the ARRK group, offers an interdisciplinary environment for autonomous driving data-driven software projects. You will develop scalable data products, build ETL pipelines, and contribute to AI-driven solutions while collaborating with stakeholders across the project lifecycle.

The role focuses on data engineering, cloud platforms, and ML capabilities, with opportunities to influence architecture and document technical decisions.