TikTok LIVE - Global Content Quality Analyst

Borr Drilling; Singapore; On-site; SGD 60,000 - 90,000; Full time

Job summary

A leading company in the livestream industry seeks a Content Quality Analyst to ensure high-quality content moderation on its platform. The role involves leveraging machine learning models, data analysis, and collaboration with partner teams to enhance content quality, aiming to inspire creativity and community growth.

Qualifications

• Experience in content quality management or analytics, preferably in tech.
• Proficiency in data visualization and basic understanding of machine learning.
• Strong ability to analyze complex datasets.

Responsibilities

• Ensuring high-quality content moderation across teams and analyzing performance.
• Training models with large datasets, analyzing data trends, and optimizing LLM performance.
• Developing solutions for content moderation quality and managing quality artifacts.

Skills

Data analysis

Analytical thinking

Collaboration

Attention to detail

Education

Bachelor’s degree in Business, Data Science, Computer Science, Information Technology, or Communications

Tools

Excel

Tableau

Power BI

Job description

Responsibilities

About the Team: The livestream industry has experienced tremendous growth recently and is now a key driver for TikTok's global business. It also provides joy to users worldwide and offers creators a new channel for expression. We are seeking a Content Quality Analyst to lead content moderation quality initiatives by leveraging human labeling and machine learning models, including Large Language Models (LLMs). This role is vital in maintaining content quality across the TikTok Live platform. The ideal candidate will be involved in training AI models, analyzing moderation data for insights, resolving complex content scenarios, and collaborating with partner teams to address issues. Success requires analytical thinking, ownership, collaboration, attention to detail, and a proactive approach to process improvement.

Detailed responsibilities include:

1. Ensuring high-quality content benchmarking across BPO teams, supporting onboarding and training, managing policy clarifications, calibrations, arbitration, and analyzing team performance to identify gaps and systemic issues.
2. Handling content labeling for specific queues, analyzing labeled content for trends, providing insights, and managing quality evaluation initiatives.
3. Training models with large datasets, improving model capabilities through iterative training, assisting in data preparation, and enhancing model accuracy by testing and fine-tuning. Supporting the algorithm team with examples to identify gaps in LLM decision-making, revising content, and optimizing the synergy between human input and data in LLM training.
4. Analyzing moderation and labeling data to identify trends and correlations, supporting impact analysis and solution planning.
5. Managing quality artifacts for content moderation, developing creative solutions, including technological tools, to improve output quality.

Qualifications

Minimum Qualifications:

• Bachelor’s degree in Business, Data Science, Computer Science, Information Technology, Communications, or related fields.
• Experience in content quality management, product operations, or analytics, preferably in tech, digital content, or platform moderation.
• Proficiency in data analysis and visualization tools like Excel, Tableau, Power BI.
• Basic understanding of machine learning and LLMs.
• Strong ability to analyze complex datasets and generate insights.

Preferred Qualifications:

• Strong analytical skills to translate data into strategic insights and solutions.
• Solid understanding of machine learning principles, evaluation metrics, and optimization techniques.
• Experience as RLHF annotators for leading AI/LLM companies is highly preferred.

Job Information

About TikTok: TikTok is a leading platform for short-form mobile videos, aiming to inspire creativity and bring joy. Our headquarters are in Los Angeles and Singapore, with offices worldwide.

Why Join Us: We foster creativity, diversity, and innovation, creating value for communities and inspiring joy. We value curiosity, humility, resilience, and a growth mindset. Join us to make an impact and grow together.

Diversity & Inclusion: TikTok is committed to an inclusive environment that values diverse skills, experiences, and perspectives. We aim to reflect the communities we serve and celebrate diversity.