Product Manager - AI Evaluation & Data Platform

Rakuten; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Rakuten Group, Inc. is a global leader in internet services and has a diverse ecosystem spanning across e-commerce, fintech, communications and more serving approximately 1.8 billion members worldwide. Based in Singapore's Central Business District, Rakuten Asia Pte.

Ltd. serves as the regional headquarters for Asia, driving value through areas such as advertising product development, product strategy, and data management to support Rakuten Group's global ecosystem.

Qualifications

• 5+ years of product management experience in AI/ML, evaluation, data products, or platforms.
• Experience with consumer AI products is preferred.
• Excellent analytical skills and experience with large datasets.
• Ability to define platform requirements and communicate model/prompt versioning, tracing, data pipelines, and release integration.
• Experience with A/B testing, production monitoring, user feedback, and human evaluation.
• Excellent written and verbal communication; ability to present evaluation results clearly.
• Ability to lead cross-functional teams.

Responsibilities

• Define success for Rakuten's AI products and translate requirements, user needs, and risks into measurable criteria.
• Select grading methods, calibrate automated graders with human judgment, and review transcripts and failures.
• Define the platform vision, roadmap, and requirements with engineering and data teams.
• Prioritize dataset management, model/prompt comparison, automated and human grading, multi-turn evaluation, trace review, dashboards, and release integration.
• Maintain balanced suites, convert production issues into regression tests, and improve evaluation coverage and accuracy.
• Establish governance, enable team and expert contributions, and connect evaluations with production monitoring, A/B testing, feedback, and business KPIs to guide priorities and releases.

Skills

Analytical skills

Excellent communication

Cross-functional collaboration

Job description

Rakuten Group, Inc. is a global leader in internet services and has a diverse ecosystem spanning across e-commerce, fintech, communications and more serving approximately 1.8 billion members worldwide. Based in Singapore's Central Business District, Rakuten Asia Pte.

Ltd. serves as the regional headquarters for Asia, driving value through areas such as advertising product development, product strategy, and data management to support Rakuten Group's global ecosystem.