Senior AI Testing & Quality Architect

UNIVERS PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Univers, the Platform for Physical AI, is seeking a lead in product testing to own vision, strategy, and execution across its AI-powered products. You will develop the testing frameworks, processes, and standards to evaluate functionality, reliability, and performance, ensuring high-quality solutions for customers.

You will collaborate with product and engineering teams to build a world-class testing function.

Qualifications

• 5+ years in software testing, QA, or similar technical role.
• Proven experience testing AI-powered products and SaaS platforms.
• Strong knowledge of AI evaluation methodologies and metrics.
• Experience designing testing frameworks from scratch.
• 3+ years leading QA efforts for complex products.
• Experience building QA function and selecting tools.
• Ability to translate complex issues into clear insights.
• Excellent analytical and detail-oriented problem-solving.
• Experience with cross-functional collaboration (Eng, Product, Customer teams).
• Comfortable in fast-paced startup environments with shifting priorities.
• Familiarity with automated testing frameworks and tooling.
• Experience building quality teams within growing org.

Responsibilities

• Develop and execute Univers’ overall testing strategy across AI-powered products
• Create testing frameworks and methodologies for evaluating product functionality, usability, accuracy, reliability, and performance
• Design and implement processes for testing AI outputs, including quality benchmarks, evaluation criteria, and success metrics
• Build structured test plans, test cases, and documentation to support product releases
• Identify gaps, risks, and improvement opportunities through rigorous product testing
• Partner with Engineering to improve product quality and processes
• Establish repeatable workflows for regression testing, user acceptance testing, and release validation
• Analyze testing results and provide actionable insights to improve product performance
• Develop best practices for AI evaluation, including assessing accuracy, consistency, hallucination risks, and edge cases
• Help define quality standards as Univers scales its products and customer base
• Build and evolve the testing function, including future team growth and processes

Skills

QA strategy

Automation testing

AI evaluation

Framework design

SaaS testing

LLM testing

Cross-functional teamwork

Data analysis

Job description

Univers, the Platform for Physical AI, is seeking a lead in product testing to own vision, strategy, and execution across its AI-powered products. You will develop the testing frameworks, processes, and standards to evaluate functionality, reliability, and performance, ensuring high-quality solutions for customers.

You will collaborate with product and engineering teams to build a world-class testing function.