AI Model Evaluation & Quality Strategy Specialist Graduate (AI Data Service Operations) - 2027 Start

TikTok; Kuala Lumpur; On-site; MYR 47,000 - 69,000; Full time

Job summary

TikTok is seeking a Graduate in AI Data Service Operations to help define and improve data quality standards for large model training and evaluation. You will review outputs, identify issues, and drive correction loops to ensure accuracy and consistency.

The role emphasizes collaboration with production, product, algorithm, strategy, and quality teams to scale judgment rules and knowledge assets across the end-to-end process.

Qualifications

• Bachelor's degree in related fields are welcome.
• Internship or project experience in data quality, content review, compliance, content operations, AI data, annotation, policy, or quality evaluation preferred.
• Excellent English listening, speaking, reading, and writing skills.

Responsibilities

• Define and improve data quality standards, judgment rules, and acceptance criteria for large model training and evaluation.
• Review outputs against quality standards, identify issues, drive corrections, ensure accuracy and consistency.
• Assess complex cases and turn decisions into reusable judgment rules and knowledge assets.
• Track quality performance, analyze root causes, and enhance production workflows.
• Collaborate with production, product, algorithm, strategy, and quality teams to align standards across the chain.

Skills

English proficiency

Education

Bachelor's degree in law, philosophy, economics, journalism, languages, social sciences, data, or related fields

Tools

Excel

ChatGPT/Claude

Job description

AI Model Evaluation & Quality Strategy Specialist Graduate (AI Data Service Operations) - 2027 Start

Location:

Employment Type:

Regular

Job Code:

A217308A

Share this listing:

Responsibilities

• Participate in defining and continuously improving data quality standards, judgment rules, and acceptance criteria for large model training and evaluation scenarios.
• Review data outputs against quality standards, identify issues, drive correction loops, and ensure accuracy and consistency.
• Assess complex, ambiguous, and boundary cases, and turn decisions into reusable judgment rules and knowledge assets.
• Track quality performance, analyze root causes, and recommend improvements to production-side workflows and execution.
• Work with production, product, algorithm, strategy, and quality teams to align standards across the full chain from standard-setting to production, acceptance, and feedback.

Qualifications

• Individuals who are completing or have recently completed a Bachelor's degree in law, philosophy, economics, journalism, languages, social sciences, data, or related fields are welcome.
• Internship or project experience in data quality, content review, compliance, content operations, AI data, annotation, policy, or quality evaluation is preferred.
• Excellent English listening, speaking, reading, and writing skills, with the ability to accurately understand English video and text content.
• Familiar with Excel or other common data processing tools; deep hands-on use of ChatGPT, Claude, Gemini or similar large model products is preferred.
• Strong structured thinking, abstraction, judgment, and communication skills; detail-oriented and able to explain what high-quality data means in ambiguous cases.

Job Information

About TikTok

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Why Join Us

Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.

We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Ready for a career

at TikTok?

Discover a career that energizes and excites you every day.