Big Data Engineer - Data Platform, Global E-Commerce

TikTok Pte. Ltd.; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

TikTok Pte. Ltd. in Singapore is seeking a data platform engineer to empower the business with data. You will help build a scalable data warehouse for batch and streaming data, and develop data products and dashboards to drive smarter business decisions and growth.

You will own end-to-end ETL pipelines, data modeling, and collaborate with stakeholders across teams to deliver reliable data solutions and analytics capabilities.

Qualifications

• At least 3 years of software engineering experience and 2 years in data engineering.
• Proficient in creating and maintaining complex ETL pipelines end-to-end with reliability and security.
• Familiar with data warehouse concepts and production data modeling experience.
• Familiar with at least 1 distributed computing engine such as Hive, Spark, or Flink.

Responsibilities

• Translate business requirements and end-to-end designs into technical implementations for batch and real-time data warehouse.
• Manage data modeling design, writing, and optimizing ETL jobs.
• Collaborate with the business team to build data metrics based on the data warehouse.
• Responsible for building and maintaining data products.
• Involved in rollouts, upgrades, implementations, and releases of data system changes.

Skills

ETL pipelines

Data warehousing

Data modeling

Distributed computing

Tools

Hive

Spark

Flink

HBase

Job description

Responsibilities

The mission of the Data Platform Singapore Business Partnering (DPSG BP) team is to empower the business with data. Our goal is to build a Data Warehouse that can cater to batch and streaming data, Data Products that provide useful information to build efficient data metrics & dashboards which will be used to make smarter business decisions to support business growth. If you're looking for a challenging ground to push your limits, this is the team for you! Responsibilities

• Translate business requirements & end to end designs into technical implementations and responsible for building batch and real-time data warehouse.
• Manage data modeling design, writing, and optimizing ETL jobs.
• Collaborate with the business team to build data metrics based on data warehouse.
• Responsible for building and maintaining data products.
• Involvement in rollouts, upgrades, implementation, and release of data system changes as required for streamlining of internal practices.
• Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software.
• Apply data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets.
• Visualise, interpret, and report data findings and may create dynamic data reports as well.

Qualifications

Minimum Qualification(s):

• At least 3 years of experience in software engineering and 2 years of relevant experience in data engineering.
• Proficient in creating and maintaining complex ETL pipelines end-to-end while maintaining high reliability and security.
• Familiar with data warehouse concepts and have production experience in modeling design.
• Familiar with at least 1 distributed computing engine (e.g. Hive, Spark, Flink).

Preferred Qualification(s):

• Familiar with at least 1 NoSQL database is a plus (e.g. HBase).
• Excellent interpersonal and communication skills with the ability to engage and manage internal and external stakeholders across all levels of seniority.
• Strong collaboration skills with the ability to build rapport across teams and stakeholders.