AI Systems PM: Reliability, Evals & Agents

AI Chopping Block; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

A1 is seeking a deeply technical product leader to work with ML, backend, and mobile engineers on system design, evaluation, and trade-offs-defining requirements. You will translate AI capabilities into reliable, user-centered product decisions and own the quality and roadmap of AI features for global users.

You will define end-to-end AI system requirements, balance quality with latency and cost, and drive rapid iteration with clear specs and strong prioritisation.

Qualifications

• Strong grounding in computer science fundamentals and system design.
• Solid understanding of ML fundamentals and production AI systems.
• Ability to read, review and discuss technical design documents.
• Hands-on experience with AI-powered products including LLM-based systems.
• Experience evaluating models, iterating prompts/pipelines, and using feedback loops.
• Proven ability to own complex, technical products end-to-end.

Responsibilities

• Research and define end-to-end AI system requirements from capability to behaviour to user impact.
• Translate model capabilities and data constraints into product and system decisions.
• Make trade-offs across quality, latency, cost, reliability, and UX.
• Collaborate with ML, backend, and mobile engineers on system design and iteration.
• Define and evolve evaluation frameworks across offline metrics, online experiments, and human feedback.
• Drive execution with clear specs, strong judgment, and disciplined prioritisation.
• Ensure systems ship quickly, safely, and reliably with strong feedback loops.
• Own product quality end-to-end - correctness, predictability, and user trust.

Skills

Algorithms

Data structures

System design

ML fundamentals

LLM-based systems

Model evaluation

Prompt engineering

Product leadership

Job description

A1 is seeking a deeply technical product leader to work with ML, backend, and mobile engineers on system design, evaluation, and trade-offs-defining requirements. You will translate AI capabilities into reliable, user-centered product decisions and own the quality and roadmap of AI features for global users.

You will define end-to-end AI system requirements, balance quality with latency and cost, and drive rapid iteration with clear specs and strong prioritisation.