Big Data Engineer, TikTok ShortText Recommendation Architecture

TIKTOK PTE. LTD.; Singapore; On-site; SGD 60,000 - 80,000; Full time

Job summary

A leading social media platform in Singapore is hiring for a role focused on optimizing recommendation systems. The ideal candidate will have a Bachelor's degree in Computer Science or a related field and 3+ years of experience in big data frameworks such as Hadoop and Spark. Responsibilities include designing data architecture and troubleshooting production systems. A collaborative mindset and effective communication skills are essential. Competitive salary and inclusive work culture offered.

Qualifications

• 3+ years of experience required.
• Familiarity with big data frameworks.
• Effective communication skills essential.

Responsibilities

• Design and implement offline data architecture.
• Troubleshoot production system for stability.
• Visualize and report data findings.

Skills

Open source frameworks

Data mining

Data modelling

Natural language processing

Machine learning

Programming (C/C++/Java/Golang)

Education

Bachelor's degree in Computer Science or related fields

Tools

Hadoop

Spark

Kafka

ElasticSearch

Job description

TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok sponsorship of a visa.

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and its offices include New York, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Why Join Us

Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible. Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day. To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve. Join us.

About the team

Our Recommendation Architecture Team is responsible for building up and optimizing the architecture for recommendation system to provide the most stable and best experience for our TikTok users. We cover almost all short-text recommendation scenarios in TikTok, such as search suggestions, the video-related search bar, and comment entities. Our recommendation system supports personalized sorting for queries, optimizing the user experience and improving TikTok's search awareness.

Responsibilities

• Design and implement a reasonable offline data architecture for large-scale recommendation systems
• Design and implement flexible, scalable, stable and high-performance storage and computing systems
• Trouble-shooting of the production system, design and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system
• Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive date and large-scale business systems
• Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software
• Applying data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets
• Visualise, interpret, and report data findings and may create dynamic data reports as well

Qualifications

Minimum Qualifications

• Bachelor\'s degree or above, majoring in Computer Science, or related fields, with at 3+ years of experience
• Familiar with many open source frameworks in the field of big data, e.g. Hadoop, Hive, Flink, FlinkSQL, Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch, etc.
• Experience in programming, including but not limited to, the following programming languages: c, C++, Java or Golang
• Effective communication skills and a sense of ownership and drive
• Experience of Peta Byte level data processing is a plus

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.