Autonomous Driving Data Engineer - Scale AI Pipelines

Mitsui Chemicals Group; Kuala Lumpur; On-site; MYR 120,000 - 180,000; Full time

Benefits offered by this job

Exciting projects

Employee events

Creative scope

Pleasant working atmosphere

Job summary

ARRK Malaysia Sdn Bhd in Kuala Lumpur is seeking a data engineering professional to design, build, and optimize data pipelines for large-scale data and AI applications. The role focuses on data transformation, analytics, and scalable software development within an interdisciplinary team.

You will collaborate with stakeholders, implement ETL processes, and contribute to architectural decisions while maintaining and documenting software, with an office-based work arrangement.

Qualifications

• University degree in Data Engineering, Data Science, CS, Software Engineering, Mathematics or comparable field.
• Practical experience with cloud platforms such as Azure, AWS, or Palantir (e.g., Databricks, ADX, Glue, Azure Data Factory, Foundry).
• Experience developing SQL/KQL dashboards.
• Strong knowledge of data modeling, data engineering, and/or data management.
• Experience in data science and/or machine learning.
• Excellent Python skills and solid knowledge of Apache Spark.
• Additional programming experience is a plus (e.g., JavaScript, C/C++, Java).
• Experience with containerization and orchestration technologies such as Docker, Kubernetes, or ARGO Workflows is an advantage.

Responsibilities

• Develop highly scalable digital products and services for automated consolidation, processing, and analysis of large-scale data sets
• Design and implement efficient data transformations, pipelines, and ETL processes
• Build data pipelines for cutting-edge AI applications
• Evaluate emerging technologies and industry trends, contributing to architectural decisions and fostering innovative solutions
• Collaborate closely with stakeholders and customers throughout development, deployment, and operations to ensure continuous improvement
• Maintenance and support of the developed software
• Creation of documentation and presentations for the software

Skills

Python

SQL dashboards

Data modeling

Data engineering

Machine learning

Spark

Cloud platforms

Container orchestration

Education

University degree in Data Engineering/Data Science/CS/Software Engineering/Mathematics

Tools

Databricks

Foundry

Azure Data Factory

Glue

Docker

Kubernetes

ARGO Workflows

Job description

ARRK Malaysia Sdn Bhd in Kuala Lumpur is seeking a data engineering professional to design, build, and optimize data pipelines for large-scale data and AI applications. The role focuses on data transformation, analytics, and scalable software development within an interdisciplinary team.

You will collaborate with stakeholders, implement ETL processes, and contribute to architectural decisions while maintaining and documenting software, with an office-based work arrangement.