Big Data Engineer, TikTok Recommendation Architecture

TIKTOK PTE. LTD.; Singapore; On-site; SGD 80,000 - 100,000; Full time

Job summary

A leading social media platform in Singapore is looking for an experienced professional to join their Recommendation Architecture Team. The role involves designing and implementing stable data architectures for large-scale recommendation systems and optimizing performance. The ideal candidate has at least 3 years of experience in relevant fields, strong coding skills, and familiarity with big data tools like Hadoop and Spark. This position offers the opportunity to work in a dynamic and creative environment.

Qualifications

• Familiar with many open source frameworks in the field of big data.
• Strong enthusiasm for learning new technologies.
• At least 3 years of relevant experience.

Responsibilities

• Design and implement offline data architecture for recommendation systems.
• Troubleshoot production systems to ensure stability.
• Develop techniques to transform raw data into meaningful information.

Skills

Data mining

Natural language processing

Machine learning

Troubleshooting

Education

Bachelor's degree in computer science or related field

Tools

Hadoop

Spark

Kafka

ElasticSearch

Job description

Overview

TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo.

Why Join Us

Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.

Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.

To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.

At TikTok, we create together and grow together. That\'s how we drive impact - for ourselves, our company, and the communities we serve.

Join us.

About The Team

Our Recommendation Architecture Team is responsible for building up and optimizing the architecture for our recommendation system to provide the most stable and best experience for our TikTok users.

The team is responsible for system stability and high availability, online services and offline data flow performance optimization, solving system bottlenecks, reducing cost overhead, building data and service mid-platform, realizing flexible and scalable high-performance storage and computing systems.

Responsibilities

• Design and implement a reasonable offline data architecture for large-scale recommendation systems
• Design and implement flexible, scalable, stable and high-performance storage and computing systems
• Trouble-shooting of the production system, design and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system
• Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive data and large-scale business systems
• Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software
• Apply data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets
• Visualise, interpret, and report data findings and may create dynamic data reports as well

Qualifications

1. Bachelor\'s degree or above in computer science, software engineering, or a related field
2. Familiar with many open source frameworks in the field of big data, e.g.Hadoop, Hive,Flink, FlinkSQL,Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch etc.
3. Familiar with Java, C++ and other programming languages
4. Strong coding and trouble shooting ability
5. Willing to challenge questions that have no obvious answers, and have a strong enthusiasm for learning new technologies
6. Experience of Peta Byte level data processing is a plus
7. At least 3 years of relevant experience

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.