Senior Data Engineer: Data Warehouse & Real-Time Solutions

Shopee; Indonesia; On-site; IDR 360,000,000 - 700,000,000; Full time

Job summary

Shopee is seeking a data engineer to participate in building and enhancing our Marketplace data warehouse, including offline and real-time data pipelines. You will collaborate with multiple teams to design data architectures and deliver efficient data solutions for BI analysis, data products, and algorithm applications.

You will also focus on evolving the data architecture, improving data quality, and handling massive data processing with new technologies to boost productivity.

Qualifications

• Bachelor degree or above in computer related field with at least 3 years of full-time experience.
• Experience with Spark, Flink, Hadoop, HBase, Kafka, Druid or ClickHouse.
• Proficient in Java, Scala, Python or SQL.
• Familiar with data warehouse architecture and performance tuning.
• Strong communication and project coordination skills.

Responsibilities

• Develop data warehouse components across offline and real-time warehouses.
• Support data applications for BI, data products, and algorithms; collaborate with teams.
• Optimize data architecture and ensure data quality and productivity for massive data processing.

Skills

Big data processing

Programming languages

Data warehouse design

Communication skills

Education

Bachelor degree in computer science or related field

Tools

Spark

Flink

Hadoop

HBase

Kafka

Druid

ClickHouse

Job description

Shopee is seeking a data engineer to participate in building and enhancing our Marketplace data warehouse, including offline and real-time data pipelines. You will collaborate with multiple teams to design data architectures and deliver efficient data solutions for BI analysis, data products, and algorithm applications.

You will also focus on evolving the data architecture, improving data quality, and handling massive data processing with new technologies to boost productivity.