AI Model Evaluation & Quality Strategy Specialist Graduate (AI Data Service Operations) - 2027 Start

TikTok; Jakarta Pusat; On-site; IDR 120,000,000 - 180,000,000; Full time

Job summary

TikTok is hiring an AI Model Evaluation & Quality Strategy Specialist Graduate (AI Data Service Operations) to shape how high-quality data supports large model training. You will work on quality standards, judgment rules, and feedback loops across markets, with opportunities to learn and grow in a global AI data operations team.

As a graduate, you will tackle complex challenges, join a diverse team, and contribute to production-ready data quality workflows that impact safety and non-safety

Qualifications

• Bachelor's degree or recent graduate in law, philosophy, economics, journalism, languages, social sciences, data, or related fields.
• Internship or project experience in data quality, content review, compliance, content operations, AI data, annotation, policy, or quality evaluation preferred.
• Excellent English listening, speaking, reading, and writing skills to understand English content.
• Familiar with Excel or data processing tools; hands-on use of large model products is a plus.
• Strong structured thinking, judgment, and clear communication, especially in ambiguous cases.

Responsibilities

• Define and continuously improve data quality standards, judgment rules, and acceptance criteria for model training and evaluation.
• Review outputs against quality standards, identify issues, drive corrections, ensure accuracy and consistency.
• Assess complex, ambiguous cases and turn decisions into reusable rules and knowledge assets.
• Track quality performance, analyze root causes, and recommend improvements to workflows.
• Collaborate with production, product, algorithm, strategy, and quality teams to align standards across the full lifecycle.

Skills

English proficiency

Data quality awareness

Analytical thinking

Structured thinking

Communication skills

Education

Bachelor's degree in a relevant field

Tools

ChatGPT

Claude

Gemini

Job description

AI Model Evaluation & Quality Strategy Specialist Graduate (AI Data Service Operations) - 2027 Start

Location:

Jakarta

Employment Type:

Regular

Job Code:

A24494

Responsibilities

About the TeamGenerative AI and large language models are reshaping the core capabilities of global content platforms — and high-quality training and evaluation data is one of the key factors that determines a model's ceiling.We are the AI Data Service & Operations (ADSO) team behind TikTok's international products, responsible for producing multilingual, multimodal data assets across both safety and non-safety domains. The standards we set and the data we deliver power two critical fronts: TikTok's global content ecosystem governance strategy on one side, and the training and evaluation pipelines for AI / large language models on the other. In short, we produce the fuel that helps models truly understand content, communities, and users around the world.Role SummaryWe are looking for an AI Model Evaluation & Quality Strategy Specialist to help define what high-quality data means for large model training and evaluation. This role focuses on quality standards, judgment rules, complex case assessment, issue correction, and feedback loops that improve AI model evaluation outcomes across markets.We are looking for talented individuals to join our team. As a graduate, you will get opportunities to pursue bold ideas, tackle complex challenges, and unlock limitless growth.

Key Responsibilities

• Participate in defining and continuously improving data quality standards, judgment rules, and acceptance criteria for large model training and evaluation scenarios.
• Review data outputs against quality standards, identify issues, drive correction loops, and ensure accuracy and consistency.
• Assess complex, ambiguous, and boundary cases, and turn decisions into reusable judgment rules and knowledge assets.
• Track quality performance, analyze root causes, and recommend improvements to production-side workflows and execution.
• Work with production, product, algorithm, strategy, and quality teams to align standards across the full chain from standard-setting to production, acceptance, and feedback.

Qualifications

Minimum Qualifications

• Individuals who are completing or have recently completed a Bachelor's degree in law, philosophy, economics, journalism, languages, social sciences, data, or related fields are welcome.
• Internship or project experience in data quality, content review, compliance, content operations, AI data, annotation, policy, or quality evaluation is preferred.
• Excellent English listening, speaking, reading, and writing skills, with the ability to accurately understand English video and text content.
• Familiar with Excel or other common data processing tools; deep hands-on use of ChatGPT, Claude, Gemini or similar large model products is preferred.
• Strong structured thinking, abstraction, judgment, and communication skills; detail-oriented and able to explain what high-quality data means in ambiguous cases.

Job Information

About TikTok

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Why Join Us

Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.

We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Ready for a career at TikTok?

Discover a career that energizes and excites you every day.