AI Data Quality & Evaluation Specialist

TikTok; Kuala Lumpur; On-site; MYR 36,000 - 60,000; Full time

Job summary

TikTok is hiring a Content Quality and Evaluation Specialist Graduate (SMO) for a 2027 start. You’ll join the AI Data Service & Operations team behind TikTok’s international products, creating multilingual data assets for safety and non-safety domains.

You’ll be the gatekeeper for AI training data, defining quality standards, turning guidelines into reusable rules, and ensuring data trustworthiness across models and platforms.

Qualifications

• Bachelor's degree in data, statistics, computer science, law, linguistics, or social sciences preferred; internship or project experience in data quality or AI data a plus.
• Excellent English proficiency (listening, speaking, reading, writing) with IELTS 7.5 / TOEFL 105 or equivalent; proficient in Excel and data tools; familiarity with LLM products.
• Strong logical thinking with structured problem-decomposition, abstraction, and articulation skills; detail-oriented with a clear viewpoint on data quality.
• Demonstrated ability to interpret and apply complex guidelines or policies in content workflows.

Responsibilities

• Help design and iterate on data quality standards and acceptance criteria for LLM training and evaluation scenarios.
• Review and adjudicate data outputs against standards; identify issues and implement corrections.
• Analyze edge cases; drive discussion and turn conclusions into reusable judgment rules.
• Track quality metrics and root-cause issues; drive improvements in production processes.
• Collaborate cross-functionally with production, product, algorithm, and policy teams to align on standards.

Skills

English proficiency

Data quality

Problem solving

Attention to detail

Interpreting guidelines

Education

Bachelor's degree in data, statistics, CS, law, linguistics, or social sciences

Tools

ChatGPT

Claude

Gemini

Job description

TikTok is hiring a Content Quality and Evaluation Specialist Graduate (SMO) for a 2027 start. You’ll join the AI Data Service & Operations team behind TikTok’s international products, creating multilingual data assets for safety and non-safety domains.

You’ll be the gatekeeper for AI training data, defining quality standards, turning guidelines into reusable rules, and ensuring data trustworthiness across models and platforms.