Senior Data Engineer - MPID Team

SHOPEE IP SINGAPORE PRIVATE LIMITED; Singapore; On-site; SGD 60,000 - 110,000; Full time

Job summary

Shopee IP Singapore Private Limited is seeking a Data Engineer to join the Marketplace Intelligence and Data team. You will contribute to building both offline and real-time data warehouses and support data applications for BI and product initiatives.

You will design scalable data architectures, improve data quality, and mentor junior engineers while collaborating with cross-functional teams to deliver reliable data solutions across the business.

Qualifications

• Bachelor’s degree or higher in Computer Science, Information Technology or related fields.
• At least 2 years of full-time experience in data engineering, data analytics, or software engineering with data-intensive systems.
• Preferably experience with data warehouse architecture and principles.
• Preferably experience with big data processing technologies such as Spark, Flink, Hadoop, HBase, Kafka, Druid, Clickhouse, etc.
• Proficiency in SQL and one or more programming languages, such as Java, Scala, Python, SQL, etc.
• Good thinking logic and communication skills, as well as good project management and coordination skills.

Responsibilities

• Participate in the development work related to the Marketplace data warehouse, including data collection in offline and real-time data warehouses, data public layer construction, data application layer construction, and data governance.
• Participate in supporting the data application of various business modules, cooperate with different teams to communicate the requirement, and design data architecture to provide data users with efficient data solutions, including supporting various scenarios such as BI analysis, data products, and algorithm applications.
• Participate in the exploration and breakthrough of Marketplace's key data technologies, and be responsible for optimizing and improving the existing data architecture, improving data quality and productivity, and including massive data processing, real-time data processing, and the application of various new technologies.
• Mentoring junior data engineers to do data pipelines.

Skills

Data engineering

Data warehouse

SQL

Java/Scala/Python

Spark

Kafka

Flink

Hadoop

HBase

Druid

ClickHouse

Education

Bachelor's degree in Computer Science / Information Technology

Job description

About the Team

The Marketplace Intelligence and Data team's mission is to build sustainable and efficient data and intelligence products to facilitate Shopee's business development. The team is responsible for Shopee e-commerce data warehouse construction, merchant and operation data product construction, all-link traffic data, product algorithms, including product release, control, information optimization, SPU library and its comparison business, marketing algorithms, including Merchandising, Product Selection, Recommendation Algorithm, Evaluation Algorithms, User Profiling, and in addition, basic AI capabilities, such as Machine Translation, Speech Algorithm, Image Algorithm, and Real-person Authentication.

The data team aims to build high-quality offline and real-time data warehouses for Shopee's e-commerce business. We integrate and consolidate a variety of raw data, build consistent and common basic data models, and provide efficient data marts for different data application scenarios. We are a data solution provider, providing stable, reliable and efficient data services for each data user in the company.

Job Description

• Participate in the development work related to the Marketplace data warehouse, including data collection in offline and real-time data warehouses, data public layer construction, data application layer construction, and data governance.




• Participate in supporting the data application of various business modules, cooperate with different teams to communicate the requirement, and design data architecture to provide data users with efficient data solutions, including supporting various scenarios such as BI analysis, data products, and algorithm applications.




• Participate in the exploration and breakthrough of Marketplace's key data technologies, and be responsible for optimizing and improving the existing data architecture, improving data quality and productivity, and including massive data processing, real-time data processing, and the application of various new technologies.




• Mentoring junior data engineers to do data pipelines.

Requirements

• Bachelor’s degree or higher in Computer Science, Information technology or related fields.




• At least 2 years of full time experience in data engineering, data analytics, or software engineering with data-intensive systems.




• Preferably experience with data warehouse architecture and principles




• Preferably experience with one or more of the big data processing technologies such as Spark, Flink, Hadoop, HBase, Kafka, Druid, Clickhouse, etc.




• Proficiency in SQL and one or more programming languages, such as Java, Scala, Python, SQL, etc.




• Good thinking logic and communication skills, as well as good project management and coordination skills