LLM Evaluation & Product Ops Specialist

TikTok; Singapore; On-site; SGD 70,000 - 110,000; Full time

Job summary

TikTok is seeking a Product Operations Specialist to join the Tako team in Singapore. You will design and implement an evaluation framework for the in-app AI chatbot, bridging user insights, data analysis, and cross-functional execution to drive product improvements.

You will leverage user research to set quality standards, work with strategy and algorithm teams on metrics, and coordinate with international delivery teams to ensure timely, high-quality project delivery.

Qualifications

• Bachelor's degree or above.
• Clear ability to define diverse user scenarios and articulate experience quality standards.
• Highly detail-oriented and well-organized; strong logical thinking with a data mindset.
• Excellent communicator and collaborative team player.

Responsibilities

• Own end-to-end design and implementation of the AI chatbot evaluation framework within Tako; support ongoing product iteration and optimization.
• Leverage user research and data analysis to uncover user needs; define the ideal experience quality standard for the product and drive improvements in model capability and user satisfaction.
• Collaborate with strategy and algorithm teams to build a scenario-based evaluation metrics system for Tako; deliver analytical insights and recommendations to improve and retain search users.
• Partner with international delivery teams to drive the execution of evaluation programs; leverage automated evaluation methods to ensure projects are delivered on time and to quality standards.

Skills

Written communication

Abstract thinking

Scenario definition

Data mindset

Detail-oriented

Organized

Collaborative

Excellent communicator

Education

Bachelor's degree or above

Job description

TikTok is seeking a Product Operations Specialist to join the Tako team in Singapore. You will design and implement an evaluation framework for the in-app AI chatbot, bridging user insights, data analysis, and cross-functional execution to drive product improvements.

You will leverage user research to set quality standards, work with strategy and algorithm teams on metrics, and coordinate with international delivery teams to ensure timely, high-quality project delivery.