Big Data Engineer - Data Platform

TikTok Pte. Ltd.; Singapore; On-site; SGD 80,000 - 100,000; Full time

Job summary

A global social media company in Singapore is looking for a data engineer with expertise in ETL pipeline development and maintenance. You will translate business requirements into technical designs, manage data modeling, and collaborate with teams to build effective metrics. The ideal candidate has at least 3 years in software engineering with strong skills in data mining and natural language processing. This challenging position will require excellent communication and collaboration skills to succeed in a fast-paced environment.

Qualifications

• At least 3 years in software engineering and 2 years in data engineering.
• Proficient in creating and maintaining complex ETL pipelines.
• Familiar with data warehouse concepts and production experience in modeling design.
• Experience with distributed computing engines is essential.

Responsibilities

• Translate business requirements into technical implementations.
• Manage data modeling design and optimize ETL jobs.
• Collaborate with the business team to build data metrics.
• Maintain data products and streamline internal practices.
• Develop analytics applications to transform raw data.
• Apply data mining and machine learning techniques.

Skills

Data warehouse design

ETL pipeline maintenance

Data mining

Data modeling

Programming languages

Natural Language Processing

Machine learning

Visualization software

Tools

Hive

Spark

Flink

HBase

Job description

Responsibilities

Team Introduction The mission of the Data Platform Singapore Business Partnering (DPSG BP) team is to empower the TikTok Business with data. Our goal is to build a Data Warehouse that can cater to batch and streaming data, Data Products that provide useful information to build efficient data metrics & dashboards which will be used to make smarter business decisions to support business growth.

If you're looking for a challenging ground to push your limits, this is the team for you! Responsibilities:

• Translate business requirements & end to end designs into technical implementations and responsible for building batch and real-time data warehouse.
• Manage data modeling design, writing, and optimizing ETL jobs.
• Collaborate with the business team to building data metrics based on data warehouse.
• Responsible for building and maintaining data products.
• Involvement in rollouts, upgrades, implementation, and release of data system changes as required for streamlining of internal practices.
• Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualization software.
• Apply data mining, data modelling, natural language processing, and machine learning to extract and analyze information from large structured and unstructured datasets.
• Visualize, interpret, and report data findings and may create dynamic data reports as well.

Qualifications

Minimum Qualifications:

• At least 3 years in software engineering and 2 years of relevant experience in data engineering.
• Proficient in creating and maintaining complex ETL pipelines end-to-end while maintaining high reliability and security.
• Familiar with data warehouse concept and have production experience in modeling design.
• Familiar with at least 1 distributed computing engine (e.g. Hive, Spark, Flink).
• Familiar with at least 1 NoSQL database is a plus (e.g. HBase).

Preferred Qualifications:

• Excellent interpersonal and communication skills with the ability to engage and manage internal and external stakeholders across all levels of seniority.
• Strong collaboration skills with the ability to build rapport across teams and stakeholders.