Content Quality and Evaluation Specialist - Safety Model Operations

TikTok; Kuala Lumpur; On-site; MYR 180,000 - 240,000; Full time

Job summary

TikTok's Safety Model Operations (SMO) team monitors and improves safety models and QA processes to ensure high-quality content moderation across regions. The Delivery Team performs comprehensive quality assurance for each project, reviewing labeling accuracy, monitoring KPIs, and identifying risks.

You will build golden sets, translate policies into SOPs, drive data closed-loop improvements with cross-functional partners, and establish robust QA mechanisms to raise data accuracy and operational

Qualifications

• Bachelor’s degree or above, with preferred experience in internet Trust & Safety, Quality Assurance (QA), AI data evaluation, or policy operations.
• Exceptional logical reasoning and synthesis skills. Proven ability to navigate complex and ambiguous business scenarios to identify underlying root causes and independently deliver structured solutions.
• Professional working proficiency in English. Extreme attention to detail and standard consistency, paired with outstanding cross-cultural written and verbal communication skills.
• Highly self-motivated with a strong sense of ownership. Capable of embracing uncertainty in a fast-paced, cross-border collaborative environment, effectively driving multiple parallel tasks to deliver solid business results.

Responsibilities

• Construct and iterate the core Golden Sets for the content safety ecosystem. Curate long-tail, high-risk, and complex edge cases to establish highly accurate data standards (Ground Truth) for platform safety policies, AI model evaluation, and global enforcement teams.
• Conduct deep-dive analyses on high-risk and highly debated safety cases to accurately identify misapplication patterns and risk evolution trends. Lead the synthesis and abstraction of complex rules, translating macro policies into highly logical and executable Standard Operating Procedures (SOPs) and operational guidelines.
• Drive the content safety data closed-loop. Collaborate cross-functionally with Operations, Algorithm, Product, and global teams to identify system vulnerabilities based on Golden Set metrics, achieving bidirectional improvements in human review quality and AI agent interception efficacy.
• Systematize universal methodologies for the content quality management framework and establish robust daily Quality Assurance (QA) mechanisms. Track and attribute core data metrics to enhance overall data accuracy and operational efficiency.

Skills

QA experience

Root cause analysis

English proficiency

Cross-cultural comms

Education

Bachelor's degree

Job description

Responsibilities

About the team

The Safety Model Operations [SMO] team is responsible for building, optimizing, and maintaining machine learning models and operational processes that support TikTok's Trust & Safety systems. We ensure that automated safety models perform effectively in identifying harmful content, mitigating risks, and maintaining a safe user environment across regions.

The SMO Delivery Team plays a critical role in the organization. Its primary responsibility is to carry out the full spectrum of quality assurance activities for each project. This includes:

• - Conducting detailed reviews and complex RCA's to ensure labeling accuracy and consistency
• - Monitoring quality performance and compliance against project-specific KPIs
• - Identifying trends, risks, and potential gaps in processes or guidelines
• - Providing structured feedback and improvement recommendations to the Central Project Team
• - Supporting continual optimization of workflows, tools, and evaluation methodologies
• - Improve Model performance of AI models

Responsibilities

1. 1. Construct and iterate the core Golden Sets for the content safety ecosystem. Curate long-tail, high-risk, and complex edge cases to establish highly accurate data standards (Ground Truth) for platform safety policies, AI model evaluation, and global enforcement teams.
2. 2. Conduct deep-dive analyses on high-risk and highly debated safety cases to accurately identify misapplication patterns and risk evolution trends. Lead the synthesis and abstraction of complex rules, translating macro policies into highly logical and executable Standard Operating Procedures (SOPs) and operational guidelines.
3. 3. Drive the content safety data closed-loop. Collaborate cross-functionally with Operations, Algorithm, Product, and global teams to identify system vulnerabilities based on Golden Set metrics, achieving bidirectional improvements in human review quality and AI agent interception efficacy.
4. 4. Systematize universal methodologies for the content quality management framework and establish robust daily Quality Assurance (QA) mechanisms. Track and attribute core data metrics to enhance overall data accuracy and operational efficiency.

Qualifications

Minimum Qualifications:

1. 1. Bachelor’s degree or above, with preferred experience in internet Trust & Safety, Quality Assurance (QA), AI data evaluation, or policy operations.
2. 2. Exceptional logical reasoning and synthesis skills. Proven ability to navigate complex and ambiguous business scenarios to identify underlying root causes and independently deliver structured solutions.
3. 3. Professional working proficiency in English. Extreme attention to detail and standard consistency, paired with outstanding cross-cultural written and verbal communication skills.
4. 4. Highly self-motivated with a strong sense of ownership. Capable of embracing uncertainty in a fast-paced, cross-border collaborative environment, effectively driving multiple parallel tasks to deliver solid business results.

Preferred Qualifications:

1. 1. Familiarity with machine learning logic and data labeling frameworks is a strong plus.

About TikTok

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Why Join Us

Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy – a mission we work towards every day. We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.