LLM Evaluation & Product Ops Lead

TikTok

Singapore

On-site

SGD 90,000 - 120,000

Full time

4 days ago

Be an early applicant

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

TikTok is seeking a Product Operations specialist to join the Tako team in Singapore. You will build and operationalize an evaluation framework for Tako's in-app AI chatbot, bridging user insights, data analysis, and cross-functional execution to drive continuous product improvement.

You will own the end-to-end design and implementation of evaluation metrics, collaborate with strategy and algorithm teams, and partner with international delivery teams to ensure timely delivery and high quality

Qualifications

Must have strong written communication skills and ability to think abstractly.
Detail-oriented and well-organized with strong logical thinking.
Excellent communicator and collaborative team player.
Experience in translating user insights into actionable product improvements is a plus.

Responsibilities

Own the end-to-end design and implementation of the AI chatbot evaluation framework within Tako; support ongoing product iteration.
Leverage user research and data analysis to define the ideal experience quality standard and drive improvements in model capability and user satisfaction.
Collaborate with strategy and algorithm teams to build scenario-based evaluation metrics; deliver insights and recommendations to improve search user experience.
Partner with international delivery teams to drive the execution of evaluation programs and ensure timely, quality delivery.