Senior Data Engineer

PLT Engineering; Selangor; On-site; MYR 70,000 - 90,000; Full time

Job summary

A leading data engineering firm in Malaysia, located in Selangor, is seeking an experienced Data Engineer. The successful candidate will maintain and extend platforms using Python, Go, and Scala, working with technologies like Apache Spark and Airflow. Responsibilities include improving system performance and integrating new industry developments. The role offers the opportunity to make significant contributions to the data ecosystem. This position is based onsite in Petaling Jaya.

Qualifications

• Strong knowledge of Python, Go, and Scala for backend development.
• Experienced in maintaining data pipelines and scalable architecture.
• Familiarity with distributed compute engines and data lakes.

Responsibilities

• Maintain and extend the backend for Grab's data processing platforms.
• Improve performance and reliability of existing applications.
• Implement architectural enhancements for new use cases.
• Collaborate with the Data Engineering Manager on projects.

Skills

Python

Go

Scala

Apache Spark

Apache Airflow

Data engineering

Tools

AWS S3

Apache Trino

Starrocks

Job description

Get to Know the Team

Grab Data Engineers are key contributors to Southeast Asia's extensive data ecosystem, enabling growth through democratization of data at scale. We maintain Grab's data infrastructure, a dependable and efficient platform that supports internal data processes and company-wide data lake access. Our tech stack leverages industry-leading distributed compute engines like Apache Spark, Trino, and Starrocks, orchestrated by Airflow and backed by AWS S3. Our evolving Data Lake storage architecture utilizes modern open-source formats like Apache Iceberg and Delta in addition to traditional Apache Hive Parquet tables.

Furthermore, our team collaborates closely with Grab's Data Catalog team to offer self-service data lake capabilities powered by Datahub and Grab's AI platforms to ensure a smooth experience for users in their AI development. By abstracting away technical complexity, we empower our users with a unified, friction-free journey from initial idea to actionable insight.

Get to Know the Role

You will support the mission of the team by maintaining and extending the platform capabilities through implementation of new features and continuous improvements. You will also explore new developments in the industry and integrate them into our ecosystem to the benefit of the data community at Grab.

You will report to our Data Engineering Manager II, and you will based onsite in our Petaling Jaya office.

The Critical Tasks You Will Perform

• You will maintain and extend the Python/Go/Scala backend for Grab's Airflow, Spark, Trino and Starrocks platform
• You will modify and extend Python/Scala Spark applications and Airflow pipelines for better performance, reliability, and cost.
• You will design and implement architectural improvements for new use cases or efficiency.
• You will build platforms that can scale to the 3 Vs of Big Data (Volume, Velocity, Variety)
• You will follow various testing best practices and SRE best practices to ensure system stability and reliability.