Graduate AI Data Quality & Evaluation Specialist

TikTok; Kuala Lumpur; On-site; MYR 40,000 - 60,000; Full time

Job summary

TikTok is seeking a Content Quality and Evaluation Graduate to contribute to multilingual data quality for AI training and evaluation. You will help define standards, adjudicate outputs, and build reusable judgment rules to keep data trustworthy for model development.

The role involves collaborating with production, product, policy, and engineering teams to ensure consistent application of guidelines across data workflows, with growth opportunities in a fast-paced AI ecosystem.

Qualifications

• Bachelor's degree in data, statistics, computer science, law, linguistics, or social sciences.
• Internship, academic project, campus organization, or full-time experience in data quality, quality assurance, content moderation, compliance, content operations, editorial review, or AI data / annotation is a strong plus.
• Excellent English proficiency (listening, speaking, reading, writing) with accurate comprehension of English video and text content; IELTS 7.5 / TOEFL 105 or equivalent
• Proficient in Excel and common data tools; hands-on experience with mainstream LLM products (ChatGPT, Claude, Gemini, etc.) and a basic understanding of AI capability boundaries preferred.

Responsibilities

• Help design and iterate on data quality standards, judgment rules, and acceptance criteria for LLM training and evaluation scenarios.
• Review and adjudicate data outputs against quality standards, identify issues, and close the loop on corrections to ensure accuracy and consistency.
• Dig into complex, ambiguous, and edge cases; drive discussion and turn conclusions into reusable judgment rules and knowledge assets.
• Track quality metrics, root-cause issues, and drive improvements in production processes and execution.
• Partner cross-functionally with production, product, algorithm, and policy teams to align on quality standards and connect the 'standard → production → acceptance → feedback' loop.

Education

Bachelor's degree in data, statistics, computer science, law, linguistics, or social sciences

Tools

ChatGPT

Claude

Gemini

Excel

Job description

TikTok is seeking a Content Quality and Evaluation Graduate to contribute to multilingual data quality for AI training and evaluation. You will help define standards, adjudicate outputs, and build reusable judgment rules to keep data trustworthy for model development.

The role involves collaborating with production, product, policy, and engineering teams to ensure consistent application of guidelines across data workflows, with growth opportunities in a fast-paced AI ecosystem.