Senior AI QA Tester

Eames Consulting; Singapore; On-site; SGD 90,000 - 120,000; Full time

Job summary

A tech consulting firm in Singapore is seeking a Senior AI QA Tester to drive quality and safety in Generative AI products. The role involves designing validation strategies for AI models, developing testing frameworks, and collaborating with teams to enhance performance. Candidates should have over 8 years of experience in software quality assurance, including 5 years in AI validation. This position offers an opportunity to impact enterprise adoption of AI technology significantly.

Qualifications

• 8+ years of experience in software quality assurance or solution testing.
• At least 5 years in AI / GenAI validation and test automation.
• Strong understanding of model testing techniques, including hallucination detection.

Responsibilities

• Design and execute comprehensive validation strategies for LLMs.
• Develop structured testing frameworks that measure model performance.
• Collaborate with product owners to enhance model performance.

Skills

AI model behaviour understanding

Quality assurance

Test automation

Communication skills

Education

Bachelor’s or Master’s degree in Computer Science or Software Engineering

Job description

Overview

We are looking for a Senior AI QA Tester to join a growing team focused on driving quality, safety, and trust in Generative AI (GenAI) products used across enterprise environments. This role combines deep technical knowledge of AI model behaviour with hands‑on experience in quality engineering and testing automation. You will help shape how next‑generation AI systems are evaluated, validated, and deployed for real‑world business use.

Responsibilities

• Design and execute comprehensive validation strategies for LLMs, agentic workflows, and other GenAI solutions.
• Develop structured testing frameworks that measure reasoning accuracy, reliability, hallucination control, and context awareness.
• Build secure sandbox test environments to evaluate AI performance and compliance under enterprise conditions.
• Conduct architecture reviews and deep‑dive analysis to identify key technical differentiators, risks, and improvement priorities.
• Collaborate with product owners, data scientists, and engineering teams to enhance model performance and deliver measurable product improvements.
• Research new AI assurance tools and evaluation methodologies, integrating them into continuous testing pipelines.
• Support proof‑of‑concept initiatives with business users, demonstrating quality improvements and risk mitigation in GenAI deployments.

Qualifications

• A Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related discipline.
• 8+ years of experience in software quality assurance or solution testing, with at least 5 years in AI / GenAI validation and test automation.
• Strong understanding of model testing techniques, including hallucination detection, robustness assessment, and reasoning validation.
• Familiarity with RAG systems, agentic frameworks, and evaluation metrics for LLM‑driven applications.
• Knowledge of software quality and security standards (e.g. ISO 25010, ISO 27001, OWASP).
• Exceptional written and verbal communication skills, with the ability to translate complex technical results into actionable insights.

Benefits

You’ll be part of a team building trust in AI‑powered solutions by applying rigorous technical standards and creative problem‑solving to real‑world innovation challenges. If you are passionate about responsible AI, data quality, and continuous improvement — this opportunity will allow you to make a tangible impact on how enterprises adopt and scale GenAI technology.