AI Product Analyst, Open-Source AI Evaluation

Government Technology Agency (GovTech); Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

GovTech is seeking a Product Analyst-level professional to bridge AI research with practical evaluation needs. You will design offline A/B experiments for Project Moonshot, help build benchmark datasets, and translate research into actionable prototypes for engineering teams.

Ideal candidates have 1-3 years in data science, strong Python/R skills, and the ability to communicate insights clearly to diverse audiences. The role emphasizes user-centric results and practical AI testing practices.

Qualifications

• Background in Statistics or Data Science or related technical field.
• 1-3 years’ experience as a data scientist with experimental design experience.

Responsibilities

• Design and run offline A/B experiments for evaluation pipelines in Project Moonshot.
• Contribute to development and maintenance of benchmark datasets and generate realistic test cases.
• Research GenAI evaluation best practices and translate findings into prototypes for engineering teams.
• Educate and engage the developer community on benchmark testing challenges and solutions.

Skills

Statistics

Data Science

Experimental design

Python

R

Communication

Storytelling with data

AI testing

Education

Bachelor's degree in Statistics or Data Science

Tools

Python

R

Job description

GovTech is seeking a Product Analyst-level professional to bridge AI research with practical evaluation needs. You will design offline A/B experiments for Project Moonshot, help build benchmark datasets, and translate research into actionable prototypes for engineering teams.

Ideal candidates have 1-3 years in data science, strong Python/R skills, and the ability to communicate insights clearly to diverse audiences. The role emphasizes user-centric results and practical AI testing practices.