AI Data Quality & Evaluation Specialist

TikTok; Kuala Lumpur; On-site; MYR 120,000 - 180,000; Full time

Job summary

TikTok is seeking an Eco Content Quality and Evaluation Specialist to gatekeep AI training data, define quality standards, and ensure data trustworthiness across multilingual, multimodal datasets. You will shape judgment rules and collaborate with cross-functional teams to align production with quality acceptance feedback.

The role focuses on safeguarding data quality for AI training and evaluation, influencing governance strategy and model performance across global platforms.

Qualifications

• Bachelor's degree or above in data, statistics, computer science, law, linguistics, or social sciences preferred.
• Internship, academic project, campus org, or full-time experience in data quality, QA, content moderation, compliance, or AI data/annotation is a strong plus.
• Excellent English proficiency (listening, speaking, reading, writing) with accurate comprehension of English video and text content.
• Proficient in Excel and common data tools; hands-on experience with mainstream LLM products and a basic understanding of AI capabilities.
• Strong logical thinking with structured problem-decomposition, abstraction, and articulation; detail-oriented with a view on data quality.
• Ability to interpret and apply complex guidelines in writing-focused workflows; internship, research, and project experience count.

Responsibilities

• Design and iterate data quality standards, judgment rules, and acceptance criteria for LLM training and evaluation.
• Review data outputs against quality standards and implement corrections for consistency and accuracy.
• Tackle complex edge cases, drive discussions, and convert conclusions into reusable rules and assets.
• Track quality metrics, root causes, and drive improvements in production processes.
• Collaborate cross-functionally to align on quality standards across production, product, algorithm, and policy teams.

Skills

English proficiency

Excel and data tools

Structured problem solving

Policy/guidelines interpretation

Data quality/QA experience

LLM data / annotation experience

Education

Bachelor's degree or above in data, statistics, CS, law, linguistics, or social sciences

Tools

ChatGPT

Claude

Gemini

AI data tools

Job description

TikTok is seeking an Eco Content Quality and Evaluation Specialist to gatekeep AI training data, define quality standards, and ensure data trustworthiness across multilingual, multimodal datasets. You will shape judgment rules and collaborate with cross-functional teams to align production with quality acceptance feedback.

The role focuses on safeguarding data quality for AI training and evaluation, influencing governance strategy and model performance across global platforms.