Content Quality and Evaluation Graduate - AI Data Service Operations

TikTok Pte. Ltd.; Kuala Lumpur; On-site; MYR 33,000 - 61,000; Full time

Job summary

TikTok Pte. Ltd. invites a Content Quality and Evaluation Graduate to join AI Data Service Operations in Kuala Lumpur. You will help define quality standards for training data and evaluate outputs to ensure accuracy and consistency across models and business processes.

The role emphasizes design of judgment rules, handling edge cases, tracking quality metrics, and collaborating with product, algorithm, and policy teams to close the loop from standard to production.

Qualifications

• Bachelor's degree in data / statistics / CS / law / linguistics / social sciences.
• Excellent English proficiency (IELTS 7.5 / TOEFL 105 or equivalent).
• Strong analytical thinking and ability to interpret complex guidelines.
• Experience evaluating qualitative content or improving processes.
• Self-starter with ability to manage multiple priorities in a fast-paced environment.
• Proficient in Excel and data tools; familiarity with mainstream LLMs.

Responsibilities

• Help design and iterate on data quality standards, judgment rules, and acceptance criteria for LLM training and evaluation scenarios.
• Review and adjudicate data outputs against quality standards, identify issues, and close the loop on corrections.
• Address complex, ambiguous, and edge cases; drive discussion and turn conclusions into reusable rules.
• Track quality metrics, root-cause issues, and drive improvements in production processes.
• Partner cross-functionally with production, product, algorithm, and policy teams to align on quality standards.

Skills

English proficiency

Analytical thinking

Excel

LLM familiarity

Education

Bachelor's degree in data/statistics/CS/law/linguistics/social sciences

Tools

Data tools

Job description

Content Quality and Evaluation Graduate - AI Data Service Operations

As an Eco Content Quality and Evaluation graduate, you'll sit at the intersection of model performance and ecosystem governance. You'll act as the gatekeeper for AI training and evaluation data — defining quality standards, unifying judgment criteria, and safeguarding data trustworthiness and consistency, so that every data point holds up under the scrutiny of both models and the business.

Key responsibilities

• Help design and iterate on data quality standards, judgment rules, and acceptance criteria for LLM training and evaluation scenarios
• Review and adjudicate data outputs against quality standards, identify issues, and close the loop on corrections to ensure accuracy and consistency
• Dig into complex, ambiguous, and edge cases; drive discussion and turn conclusions into reusable judgment rules and knowledge assets
• Track quality metrics, root-cause issues, and drive improvements in production processes and execution
• Partner cross-functionally with production, product, algorithm, and policy teams to align on quality standards and connect the "standard → production → acceptance → feedback" loop

About you

• Completing or have recently completed a Bachelor's degree in data, statistics, computer science, law, linguistics, or social sciences
• Excellent English proficiency (listening, speaking, reading, writing) with accurate comprehension of English video and text content; IELTS 7.5 / TOEFL 105 or equivalent
• Strong logical thinking with structured problem-decomposition, abstraction, and articulation skills; detail-oriented, with your own point of view on "what makes good data"
• Demonstrated ability to interpret and apply complex guidelines or policies in writing-focused workflows, and some experience evaluating qualitative content or using data to improve processes
• A self-starter mindset, solution-oriented thinking, and the ability to manage multiple priorities in a fast-paced, collaborative environment
• Proficient in Excel and common data tools; hands-on experience with mainstream LLM products (ChatGPT, Claude, Gemini, etc.) and a basic understanding of AI capability boundaries preferred

About us

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo. We are committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives.

Unlock job insights

Hirer responsiveness Salary match Number of applicants

Online Media & eCommerce More than 10,000 employees

TikTok is the world's leading destination for short-form video. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.

Our employees lead with curiosity, and move at the speed of culture. Combined with our company's flat structure, you'll be given dynamic opportunities to make a real impact on a rapidly expanding company as you grow your career. We have offices across Asia Pacific, the Middle East, Europe, and the Americas – and we're just getting started.

TikTok is the world's leading destination for short-form video. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.

Our employees lead with curiosity, and move at the speed of culture. Combined with our company's flat structure, you'll be given dynamic opportunities to make a real impact on a rapidly expanding company as you grow your career. We have offices across Asia Pacific, the Middle East, Europe, and the Americas – and we're just getting started.