AI Data Quality & Evaluation Analyst (Graduate)

TikTok Pte. Ltd.; Kuala Lumpur; On-site; MYR 33,000 - 61,000; Full time

Job summary

TikTok Pte. Ltd. invites a Content Quality and Evaluation Graduate to join AI Data Service Operations in Kuala Lumpur. You will help define quality standards for training data and evaluate outputs to ensure accuracy and consistency across models and business processes.

The role emphasizes design of judgment rules, handling edge cases, tracking quality metrics, and collaborating with product, algorithm, and policy teams to close the loop from standard to production.

Qualifications

• Bachelor's degree in data / statistics / CS / law / linguistics / social sciences.
• Excellent English proficiency (IELTS 7.5 / TOEFL 105 or equivalent).
• Strong analytical thinking and ability to interpret complex guidelines.
• Experience evaluating qualitative content or improving processes.
• Self-starter with ability to manage multiple priorities in a fast-paced environment.
• Proficient in Excel and data tools; familiarity with mainstream LLMs.

Responsibilities

• Help design and iterate on data quality standards, judgment rules, and acceptance criteria for LLM training and evaluation scenarios.
• Review and adjudicate data outputs against quality standards, identify issues, and close the loop on corrections.
• Address complex, ambiguous, and edge cases; drive discussion and turn conclusions into reusable rules.
• Track quality metrics, root-cause issues, and drive improvements in production processes.
• Partner cross-functionally with production, product, algorithm, and policy teams to align on quality standards.

Skills

English proficiency

Analytical thinking

Excel

LLM familiarity

Education

Bachelor's degree in data/statistics/CS/law/linguistics/social sciences

Tools

Data tools

Job description

TikTok Pte. Ltd. invites a Content Quality and Evaluation Graduate to join AI Data Service Operations in Kuala Lumpur. You will help define quality standards for training data and evaluate outputs to ensure accuracy and consistency across models and business processes.

The role emphasizes design of judgment rules, handling edge cases, tracking quality metrics, and collaborating with product, algorithm, and policy teams to close the loop from standard to production.