AI Evaluation Product Manager

Plaud; Singapore; On-site; SGD 90,000 - 120,000; Full time

Job summary

A leading AI technology company based in Singapore is seeking an AI Evaluation Product Manager to define and enhance AI memory evaluation standards. The role involves building a global evaluation system and continuously assessing product performance. Candidates should have a Master's degree and at least three years of product experience, particularly in AI or LLM fields. This position offers a market-competitive salary and a dynamic work environment.

Benefits

Market-competitive compensation

Global exposure

Continuous learning opportunities

Qualifications

• 3+ years of product experience, with at least 1 year in AI or LLM-related products.
• Strong ownership and structured problem-solving skills.
• Understanding of English-speaking user scenarios.

Responsibilities

• Shape how AI understands, stores and recalls human knowledge.
• Define evaluation standards and frameworks.
• Run continuous quality evaluations across memory-enabled experiences.

Skills

Analytical skills

Data processing

Clear communication in English

Problem solving

Ownership

Education

Master's degree in Computer Science, Data Science, AI or related fields

Tools

SQL

Python

Job description

Plaud AI is hiring AI Evaluation Product Manager

Location: Singapore

About Plaud Inc.

Plaud is building the world's most trusted AI work companion for professionals to elevate productivity and performance through note‑taking solutions, loved by over 1,000,000 users worldwide since 2023. With a mission to amplify human intelligence, Plaud is building the next‑generation intelligence infrastructure and interfaces to capture, extract, and utilize what you say, hear, see, and think.

Plaud Inc. is a Delaware‑incorporated, San Francisco‑based company pushing the boundary of human–AI intelligence through a hardware–software combination. With ISO 27001, ISO 27701, GDPR, SOC 2, HIPAA, and EN 18031 compliance, Plaud is committed to the highest standards of data security and privacy protection.

To learn more about Plaud, please visit https://www.plaud.ai and follow along on Instagram, X, Facebook, LinkedIn, and YouTube

Why You Should Join Us

Plaud is building the next generation intelligence infrastructure and interfaces to capture, extract, and utilize intelligence from what people say, hear, see, and think.

• Plaud is a bootstrapped, skyrocketing, profitable company with a $250M revenue run rate achieved in just three years.
• Define the next‑gen paradigm for human‑AI interaction.
• Gain exposure to cutting‑edge AI for Pro tools and play a direct role in our global expansion.
• Work with passionate teammates who value innovation, collaboration, and customer success.
• Grow your career in a culture that champions continuous learning and fast career development.
• Market‑competitive compensation, global exposure, and a vibrant, creativity‑fueled work atmosphere.

What You Will Do

• Plaud is building the future of AI‑native productivity — where meetings, conversations, and knowledge become an extension of your memory. As the first dedicated owner of Memory Evaluation, you will shape how AI understands, stores and recalls human knowledge for millions of users worldwide.
• Define how 'AI memory quality' should be measured for the industry. Turn product goals and real user scenarios into measurable evaluation criteria, evaluation frameworks and reproducible test cases.
• Build the global memory evaluation system from the ground up. Create evaluation standards, test pipelines, and datasets across markets (US, EU, Japan, China), working with real multilingual and multimodal data.
• Run continuous quality evaluations across Summary, Ask Plaud and other memory‑enabled experiences, combining scalable automated workflows with targeted human checks when precision matters.
• Become the source of truth for ‘is memory working?’ Your analysis will directly influence product decisions, launch readiness, and go‑to‑market.
• Benchmark against global AI meeting and knowledge products (Otter, Notion AI, NotebookLM, etc.) to extract best practices in memory accuracy, retrieval reliability, and user trust — and convert these insights into scientific evaluation methodology.

Minimum Qualifications

• Master's degree or above, preferably in Computer Science, Data Science, AI, or related fields.
• 3+ years of product experience, with at least 1 year working on AI or LLM‑related products or features.
• Solid analytical skills and familiarity with data processing (SQL/Python preferred).
• Ability to communicate clearly in English and collaborate across product, engineering, and operations.
• Strong ownership, structured problem solving, and willingness to learn quickly.
• Understanding of English‑speaking user scenarios, product expectations, or cultural differences.

Preferred Qualifications

• Hands‑on experience designing test plans, evaluation standards, or datasets for LLM or AI features.
• Familiarity with evaluation of memory‑related behaviors (extraction, retrieval, contextual usage), or prior work on summary/Ask AI products.
• Experience reviewing real user data and translating findings into actionable product improvements.

Disclaimer: Plaud is and will continue to be an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristics.