Graduate AI Data Quality & Evaluation Specialist

TikTok; Kuala Lumpur; On-site; MYR 33,000 - 62,000; Full time

Job summary

TikTok seeks an Content Quality and Evaluation Graduate to design data quality standards and oversee evaluation data for multilingual AI training. You will adjudicate outputs, handle edge cases, and collaborate with policy, product, and engineering teams to maintain data trustworthiness.

The role emphasizes rigorous quality judgment, attention to detail, and the ability to translate guidelines into actionable rules within a fast-paced environment.

Qualifications

• Bachelor's degree in data, statistics, computer science, law, linguistics, or social sciences preferred.
• Internship, academic project, campus organization, or full-time experience in data quality, quality assurance, content moderation, compliance, content operations, editorial review, or AI data/annotation is a strong plus.
• Excellent English proficiency (listening, speaking, reading, writing) with accurate comprehension of English video and text content; IELTS 7.5 / TOEFL 105 or equivalent
• Proficient in Excel and common data tools; hands‑on experience with mainstream LLM products (ChatGPT, Claude, Gemini, etc.) and a basic understanding of AI capability boundaries preferred.

Responsibilities

• Help design and iterate on data quality standards, judgment rules, and acceptance criteria for LLM training and evaluation scenarios.
• Review and adjudicate data outputs against quality standards, identify issues, and ensure corrections for accuracy and consistency.
• Tackle complex, ambiguous, and edge cases; drive discussion and turn conclusions into reusable rules and knowledge assets.
• Track quality metrics, root-cause issues, and drive improvements in production processes.
• Partner cross-functionally with production, product, algorithm, and policy teams to align on quality standards and the feedback loop.

Skills

English proficiency

Excel

LLM familiarity

Data quality

Education

Bachelor's degree in data/science/CS/linguistics/social sciences/law

Tools

ChatGPT

Claude

Gemini

Job description

TikTok seeks an Content Quality and Evaluation Graduate to design data quality standards and oversee evaluation data for multilingual AI training. You will adjudicate outputs, handle edge cases, and collaborate with policy, product, and engineering teams to maintain data trustworthiness.

The role emphasizes rigorous quality judgment, attention to detail, and the ability to translate guidelines into actionable rules within a fast-paced environment.