Product Manager, AI Evaluation & Data Platform

Rakuten Asia Pte Ltd; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Rakuten Asia Pte. Ltd. in Singapore is seeking a Product Manager – Evaluation and Data to define how AI product quality is measured and improved. You will own the evaluation strategy, coordinating with product, engineering, data science, analytics, and business teams.

The role focuses on building scalable evaluation platforms, automating graders, developing data pipelines, and governance to guide release decisions and KPIs.

Qualifications

• 5+ years in AI/ML product management or data platforms.
• Strong analytical skills with large datasets.
• Ability to define platform requirements and data pipelines.
• Experience with A/B testing and production monitoring.
• Excellent written and verbal communication.
• Proven cross-functional leadership.

Responsibilities

• Define evaluation strategy and measurable success criteria.
• Design and calibrate graders and review transcripts.
• Define platform roadmap with engineering and data teams.
• Prioritize datasets, model/prompt evaluation tooling, and monitoring capabilities.
• Connect evaluations with production monitoring and business KPIs.

Skills

AI/ML PM

Data analysis

Platform requirements

A/B testing

Cross-functional leadership

Communication

Job description

Rakuten Asia Pte. Ltd. in Singapore is seeking a Product Manager – Evaluation and Data to define how AI product quality is measured and improved. You will own the evaluation strategy, coordinating with product, engineering, data science, analytics, and business teams.

The role focuses on building scalable evaluation platforms, automating graders, developing data pipelines, and governance to guide release decisions and KPIs.