AI Agent Operations Specialist （Model Data Operations) - TikTok Platform Safety

TikTok; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

TikTok Singapore is seeking a Content Risk & AI Product Operations Specialist to lead prompt strategy under the Platform Responsibility team. You will refine prompts, manage samples, and analyze risks to uphold strict content safety standards.

You'll work on AI-driven risk detection, maintain knowledge bases for current affairs vocabulary, and monitor metrics daily to drive improvements in recall accuracy and overall safety performance.

Qualifications

• Bachelor's degree or above with 1+ years in content risk control, strategy operation, Search Suggestion strategy, or AI Product Operation.
• Deep understanding of LLM principles and practical experience in Prompt Engineering.
• Demonstrated data analysis skills to identify strategic issues from data fluctuations.

Responsibilities

• Refine prompting and maintain a prompt library for risk scenarios.
• Manage few-shot sample library and cover latest variants and edge cases.
• Root cause analysis for false negatives/positives and adjust prompts or samples.
• Adjust prompt strategy for events and post-event reviews.
• Maintain external knowledge base for risk vocabularies and monitor metrics daily.

Skills

Content risk

Strategy operations

Prompt engineering

Data analysis

LLM principles

Education

Bachelor's degree or above

Job description

Responsibilities

About the Team The Platform Responsibility team is bringing disruptive innovation to content safety through the deep application of AI. We are building next-generation infrastructure that leverages advanced LLMs to reshape risk detection and governance. By engineering high-quality data pipelines and integrating AI into core decision-making, we drive exponential efficiency gains and precision. Working at the intersection of scalable engineering and technology, we empower global business growth while serving as the foundation of user trust.

About the Role Under the spirit of TikTok Community Guidelines, the team leverages the capabilities of LLM and prompt engineering to deliver a large model Agent that can represent "absolute correctness", providing evaluation capabilities for TikTok content safety. This role will lead the team to refine strategy operations and prompt optimization to enhance the Agent's precise recall ability for risky content.

Responsibilities:

Prompt Engineering and Prompt Tuning

• Refined Prompting: Responsible for writing and debugging Prompts for specific risk scenarios. Maintain the Prompt version library to ensure the most appropriate instruction combinations are used for different scenarios.
• Few-shot Sample Library Management: Filter and maintain high-quality Few-shot samples (Examples). Ensure that the samples cover the latest underground industry variants and edge cases.

Badcase Attribution and Closed Loop Iteration

• Root Cause Analysis: Conduct in-depth analysis of cases that slipped through online (False Negative) or were wrongly removed (False Positive). Determine whether it is due to ambiguous Prompt instructions, outdated samples, or ambiguity in the Policy itself.
• In response to sudden public opinion events or new types of underground industry attacks, quickly adjust the Prompt strategy for interception, and convert the temporary strategy into long-term capabilities during the post-event review.

Knowledge Base and Evaluation Operations

• Knowledge Base Maintenance: For political and current affairs, and person-related risks, maintain the external Knowledge Base (Knowledge Base) of the RAG system to ensure that the Agent can identify the latest vocabulary.
• Daily Monitoring: Monitor and evaluate metrics daily, and output daily/weekly operation reports. When abnormal fluctuations in metrics are detected, issue timely warnings and troubleshoot the causes.

Qualifications

Minimum Qualification(s):

• Bachelor's degree or above with 1+ years of experience in content risk control, strategy operation, Search Suggestion strategy, or AI Product Operation. Deep understanding of content safety business.
• Has a deep understanding of LLM principles and practical experience in Prompt Engineering. Demonstrated experience in significantly improving model performance by adjusting Context, Persona, and Examples.
• Has excellent Data Analysis skills, capable of quickly identifying strategic issues through data fluctuations.

Preferred Qualification(s):

• Self-motivated and results-driven, able to influence stakeholders in fast-paced, ambiguous environments.

About TikTok

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Why Join Us

Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.

We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.