Data Engineer - Traffic Mart

SHOPEE SINGAPORE PRIVATE LIMITED; Singapore; Sur place; SGD 90 000 - 150 000; Plein temps

Résumé du poste

Shopee Singapore Private Limited is seeking a data engineer to build and operate the Marketplace data warehouse, covering batch and real-time ingestion and semantic modeling for downstream consumers.

You will collaborate with product, business, and engineering teams to design scalable data architectures that support BI reporting, self-serve analytics, and AI/ML data stacks. This role focuses on large-scale data pipelines, governance, and platform evolution.

Qualifications

• Bachelor's Degree or above in Computer Science or related fields.
• At least 3 years of data engineering experience.
• Experience with Spark, Flink, Hadoop or HBase.
• Knowledge of data warehouse architecture and principles.

Responsabilités

• Build and operate the Marketplace data warehouse end to end for batch and real-time ingestion and modeling.
• Collaborate with product, business and engineering teams to translate requirements into scalable data architectures.
• Design and optimize large-scale data pipelines for better throughput, latency, and cost across offline/streaming.
• Lead data quality and governance including schema standardization, lineage, and SLA monitoring.
• Evaluate emerging data technologies (streaming engines, lakehouse, AI/ML data stacks) to evolve the platform roadmap.

Connaissances

Data engineering

Spark

Flink

Hadoop

HBase

Python

Java

SQL

Formation

Bachelor's degree or above in Computer Science

Description du poste

The Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies. Our engineers do not merely solve problems at hand; We build foundations for a long-lasting future. We don't limit ourselves on what we can or can't do; we take matters into our own hands even if it means drilling down to the bottom layer of the computing platform. Shopee's hyper-growing business scale has transformed most \"innocent\" problems into huge technical challenges, and there is no better place to experience it first-hand if you love technologies as much as we do.

Job Description:

• Build and operate the Marketplace data warehouse end to end, covering batch and real-time ingestion, semantic layer design, and application-layer modeling for downstream consumers.
• Collaborate with product, business, and engineering teams to translate requirements into scalable data architectures that support BI reporting, self-serve analytics, and algorithmic applications.
• Design and optimize large-scale data processing pipelines, improving throughput, latency, and cost efficiency across offline and streaming platforms.
• Lead data quality and governance efforts, including schema standardization, lineage tracking, SLA monitoring, and best practices that increase reliability and user trust.
• Evaluate and adopt emerging data technologies such as streaming engines, lakehouse architectures, and AI/ML data stacks to address key Marketplace challenges and evolve the platform roadmap.

Requirements:

• Bachelor's Degree or above in Computer Science or related fields
• At least 3 years of data engineering experience
• Prior experience or knowledge working with Traffic Mart would be advantageous
• Experience with big data processing technologies such as Spark, Flink, Hadoop or HBase
• Proficiency in one or more programming languages, such as Java, Scala, Python, SQL, etc.
• Familiar with data warehouse architecture and principles