Senior Data Engineer - Data Mart

SHOPEE SINGAPORE PRIVATE LIMITED; Singapore; In loco; SGD 90.000 - 150.000; Tempo pieno

Descrizione del lavoro

The Marketplace Intelligence and Data team at Shopee Singapore is building scalable data and intelligence products to support business growth. The team is responsible for the data warehouse, merchant and operation data products, and analytics algorithms across various business areas.

You will help design data architectures, implement offline and real-time pipelines, and improve data quality and performance while collaborating with cross-functional teams to drive Shopee's data initiatives.

Competenze

• Bachelor degree or above in computer related field with at least 3 years of full time working experience.
• Familiarity with one or more big data processing technologies such as Spark, Flink, Hadoop, HBase, Kafka, Druid, Clickhouse.
• Proficiency in one or more programming languages, such as Java, Scala, Python, SQL, etc.
• Familiar with data warehouse architecture and principles, with relevant experience in big data architecture design, model design and performance tuning.
• Good thinking logic and communication skills, as well as good project management and coordination skills

Mansioni

• Participate in the development work related to the Marketplace data warehouse, including data collection in offline and real-time data warehouses, data public layer construction, data application layer construction, and data governance.
• Participate in supporting the data application of various business modules, cooperate with different teams to communicate the requirement, and design data architecture to provide data users with efficient data solutions, including supporting various scenarios such as BI analysis, data products, and algorithm applications.
• Participate in the exploration and breakthrough of Marketplace's key data technologies, and be responsible for optimizing and improving the existing data architecture, improving data quality and productivity, and including massive data processing, real-time data processing, and the application of various new technologies.]
• CoT_job_summary_short
• job_summary_short
• contract_type
• location_type
• remote_scope
• perks
• stated_min
• stated_max
• stated_absolute
• salary_estimation_cot
• estimated_low
• estimated_medium
• estimated_high
• currency
• frequency
• bonus
• tax
• application_email
• job_end_date
• contact_person
• hiring_department_name

Conoscenze

Java

Scala

Python

SQL

Data warehousing

Data governance

Communication

Project management

Formazione

Bachelor degree or above in computer related field

Strumenti

Spark

Flink

Hadoop

HBase

Kafka

Druid

Clickhouse

Descrizione del lavoro

The Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies. Our engineers do not merely solve problems at hand; We build foundations for a long-lasting future. We don't limit ourselves on what we can or can't do; we take matters into our own hands even if it means drilling down to the bottom layer of the computing platform. Shopee's hyper-growing business scale has transformed most "innocent" problems into huge technical challenges, and there is no better place to experience it first‑hand if you love technologies as much as we do.

About the Team:

The Marketplace Intelligence and Data team's mission is to build sustainable and efficient data and intelligence products to facilitate Shopee's business development. The team is responsible for Shopee e-commerce data warehouse construction, merchant and operation data product construction, all-link traffic data, product algorithms, including product release, control, information optimization, SPU library and its comparison business, marketing algorithms, including Merchandising, Product Selection, Recommendation Algorithm, Evaluation Algorithms, User Profiling, and in addition, basic AI capabilities, such as Machine Translation, Speech Algorithm, Image Algorithm, and Real-person Authentication.

The data team aims to build high-quality offline and real-time data warehouses for Shopee's e-commerce business. We integrate and consolidate a variety of raw data, build consistent and common basic data models, and provide efficient data marts for different data application scenarios. We are a data solution provider, providing stable, reliable and efficient data services for each data user in the company.

Job Description:

• Participate in the development work related to the Marketplace data warehouse, including data collection in offline and real-time data warehouses, data public layer construction, data application layer construction, and data governance.
• Participate in supporting the data application of various business modules, cooperate with different teams to communicate the requirement, and design data architecture to provide data users with efficient data solutions, including supporting various scenarios such as BI analysis, data products, and algorithm applications.
• Participate in the exploration and breakthrough of Marketplace's key data technologies, and be responsible for optimizing and improving the existing data architecture, improving data quality and productivity, and including massive data processing, real-time data processing, and the application of various new technologies.

Requirements:

• Bachelor degree or above in computer related field with at least 3 years of full time working experience.
• Familiarity with one or more big data processing technologies such as Spark, Flink, Hadoop, HBase, Kafka, Druid, Clickhouse, etc.
• Proficiency in one or more programming languages, such as Java, Scala, Python, SQL, etc.
• Familiar with data warehouse architecture and principles, with relevant experience in big data architecture design, model design and performance tuning.
• Good thinking logic and communication skills, as well as good project management and coordination skills