Big Data Platform Engineer (OLAP & Real-Time)

Shopee; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

Shopee Singapore is seeking a Data Infrastructure Engineer to build and maintain a scalable Big Data platform and OLAP engines. You will collaborate with cross-functional teams to integrate new features and technologies, ensuring reliability and high performance of our data infrastructure.

You will work on data collection, storage, offline and real-time processing, data analytics and reporting, supporting business, data analysts, ML teams and BI teams with a robust data platform and tooling.

Qualifications

• Bachelor's degree or above in Computer Science, Engineering, or related fields.
• Strong proficiency in programming languages like Java, Scala, or C++.
• Familiar with Big Data technologies (e.g. Hadoop, Spark, Flink and Kafka) and database systems.
• Experience with OLAP technologies and data modeling is highly desirable.

Responsibilities

• Develop and maintain scalable and efficient Big Data platform components and OLAP engines.
• Collaborate with cross-functional teams to integrate new features and technologies.
• Ensure the reliability and performance of our data infrastructure.
• Troubleshoot and resolve complex technical issues.
• Continuously improve system architecture and design for optimal performance.

Skills

Java

Scala

C++

Big Data

Spark

Hadoop

Flink

Kafka

OLAP

Education

Bachelor's degree or above in CS/Engineering or related fields

Tools

Hadoop

Spark

Flink

Kafka

Job description

Shopee Singapore is seeking a Data Infrastructure Engineer to build and maintain a scalable Big Data platform and OLAP engines. You will collaborate with cross-functional teams to integrate new features and technologies, ensuring reliability and high performance of our data infrastructure.

You will work on data collection, storage, offline and real-time processing, data analytics and reporting, supporting business, data analysts, ML teams and BI teams with a robust data platform and tooling.