LLM Data Quality & Evaluation Specialist (Graduate)

TikTok; Kuala Lumpur; On-site; MYR 45,000 - 78,000; Full time

Job summary

TikTok seeks a Content Quality and Evaluation Graduate (Thai - SMO) in Malaysia for a 2027 start. You will help define quality standards for multilingual data used in AI models, review data quality, and drive improvements in evaluation pipelines.

This role offers growth in a fast-paced AI data service setting with global impact. You will work with cross-functional teams, learn guidelines, and contribute to governance of model training data.

Qualifications

• Bachelor's degree in data-related field or social sciences preferred.
• Internship or project experience in data quality, content operations, or AI data/annotation is a plus.
• Excellent English skills with strong comprehension of video and text content.
• Proficient in Excel and data tools; familiarity with LLM products is a plus.
• Ability to interpret guidelines and apply policies in writing-focused workflows.

Responsibilities

• Design and iterate data quality standards, judgment rules, and acceptance criteria for LLM training and evaluation.
• Review outputs against quality standards; identify issues and implement corrections.
• Analyze edge cases and translate conclusions into reusable rules and knowledge assets.
• Track quality metrics and root-cause issues; drive process improvements.
• Collaborate with production, product, algorithm, and policy teams to align on standards.

Skills

English proficiency

Analytical thinking

Excel

Data tooling

Education

Bachelor's degree in data, statistics, CS, law, linguistics, or social sciences

Tools

Excel

ChatGPT

Claude

Gemini

Job description

TikTok seeks a Content Quality and Evaluation Graduate (Thai - SMO) in Malaysia for a 2027 start. You will help define quality standards for multilingual data used in AI models, review data quality, and drive improvements in evaluation pipelines.

This role offers growth in a fast-paced AI data service setting with global impact. You will work with cross-functional teams, learn guidelines, and contribute to governance of model training data.