Senior Big Data Platform Engineer

CEKAP LINK TECH SDN. BHD.; Kuala Lumpur; On-site; MYR 180,000 - 320,000; Full time

Job summary

CEKAP LINK TECH SDN. BHD. is seeking an experienced big data developer to design and implement high-availability data architectures in a Kuala Lumpur-based role.

You will independently develop platform modules, optimize large-scale data processing with Spark and Flink, and collaborate with data analysts and algorithm teams to deliver efficient data interfaces. Requirements include a Bachelor's degree in CS and 3+ years in big data, with proven experience in 50TB+ data platforms and expertise in

Qualifications

• Bachelor's degree or above in computer science preferred.
• 3+ years of experience in big data development.
• Experience leading the construction of a data platform of 50TB or more or reengineering core modules.
• Proficient in Hadoop/Spark/Flink ecosystem architecture.
• Familiar with Kafka/Pulsar stream architectures.
• Proficient in SQL/Hive/Python/Java/Scala.
• Familiar with Doris/StarRocks and SQL tuning.
• Understanding of full data scenarios in at least one vertical (e.g., logistics, e-commerce).
• Able to propose technical paths for business growth.
• Data product thinking and ability to translate business requirements into implementable data solutions.

Responsibilities

• Design and implement high availability and high scalability big data architectures.
• Optimize performance of large-scale data processing and reduce task times.
• Develop data platform modules independently and resolve data processing challenges.
• Collaborate with analysts and algorithm teams to provide data interfaces and tools.
• Lead or participate in designing technical solutions and producing implementation documents.

Skills

Big data thinking

Business requirements

Education

Bachelor's degree in Computer Science

3+ years experience in big data development

Tools

Hadoop

Spark

Flink

Hive

Doris

StarRocks

Kafka

Pulsar

Python

Java

Scala

Job description

CEKAP LINK TECH SDN. BHD. is seeking an experienced big data developer to design and implement high-availability data architectures in a Kuala Lumpur-based role.

You will independently develop platform modules, optimize large-scale data processing with Spark and Flink, and collaborate with data analysts and algorithm teams to deliver efficient data interfaces. Requirements include a Bachelor's degree in CS and 3+ years in big data, with proven experience in 50TB+ data platforms and expertise in