Content Quality and Evaluation Specialist (Mandarin Speaking) - Safety Model Operations

TikTok Inc.; Kuala Lumpur; On-site; MYR 180,000 - 240,000; Full time

Job summary

TikTok Malaysia's Safety Model Operations (SMO) team builds, optimizes, and maintains ML models and processes to support Trust & Safety across regions. The SMO Delivery Team handles QA, reviews RCA outcomes, and monitors project KPIs to ensure labeling accuracy and risk mitigation.

Collaboration with cross-functional teams is required to improve workflows, evaluation methodologies, and model performance, while Mandarin liaison with the China team ensures accurate communication of safety policies

Qualifications

• Experience in internet Trust & Safety, QA, AI data evaluation, or policy operations.
• Strong logical reasoning and synthesis skills for complex scenarios.
• Excellent cross-cultural written and verbal communication in English; Mandarin liaison required.

Responsibilities

• Construct and iterate the core Golden Sets for the content safety ecosystem.
• Conduct deep-dive analyses on high-risk safety cases to identify misapplications and risk trends; translate policies into SOPs.
• Drive the content safety data closed-loop with cross-functional teams to improve human review quality and AI interception efficacy.
• Systematize QA methodologies and track data metrics to boost data accuracy and operational efficiency.

Skills

Trust & Safety

QA experience

Policy operations

English

Mandarin

Job description

Responsibilities

About the team

The Safety Model Operations [SMO] team is responsible for building, optimizing, and maintaining machine learning models and operational processes that support TikTok's Trust & Safety systems. We ensure that automated safety models perform effectively in identifying harmful content, mitigating risks, and maintaining a safe user environment across regions.

The SMO Delivery Team plays a critical role in the organization. Its primary responsibility is to carry out the full spectrum of quality assurance activities for each project. This includes:

• Conducting detailed reviews and complex RCA's to ensure labeling accuracy and consistency


• Monitoring quality performance and compliance against project-specific KPIs


• Identifying trends, risks, and potential gaps in processes or guidelines


• Providing structured feedback and improvement recommendations to the Central Project Team


• Supporting continual optimization of workflows, tools, and evaluation methodologies


• Improve Model performance of AI models

Responsibilities

1. Construct and iterate the core Golden Sets for the content safety ecosystem. Curate long-tail, high-risk, and complex edge cases to establish highly accurate data standards (Ground Truth) for platform safety policies, AI model evaluation, and global enforcement teams.


2. Conduct deep-dive analyses on high-risk and highly debated safety cases to accurately identify misapplication patterns and risk evolution trends. Lead the synthesis and abstraction of complex rules, translating macro policies into highly logical and executable Standard Operating Procedures (SOPs) and operational guidelines.


3. Drive the content safety data closed-loop. Collaborate cross-functionally with Operations, Algorithm, Product, and global teams to identify system vulnerabilities based on Golden Set metrics, achieving bidirectional improvements in human review quality and AI agent interception efficacy.


4. Systematize universal methodologies for the content quality management framework and establish robust daily Quality Assurance (QA) mechanisms. Track and attribute core data metrics to enhance overall data accuracy and operational efficiency.

Qualifications

Minimum Qualification(s)

1. Proven experience in internet Trust & Safety, Quality Assurance (QA), AI data evaluation, or policy operations.


2. Exceptional logical reasoning and synthesis skills. Proven ability to navigate complex and ambiguous business scenarios to identify underlying root causes and independently deliver structured solutions.


3. Professional working proficiency in English. Extreme attention to detail and standard consistency, paired with outstanding cross-cultural written and verbal communication skills.


4. Highly self-motivated with a strong sense of ownership. Capable of embracing uncertainty in a fast-paced, cross-border collaborative environment, effectively driving multiple parallel tasks to deliver solid business results.


5. Mandarin proficiency is also required, as it is mandatory for daily liaison with the China team in the China market and the accurate communication of business information.

Preferred Qualification(s)

1. Familiarity with machine learning logic and data labeling frameworks is a strong plus.