Senior QA Engineer - AI Tools & Internal Apps

Virtuos Kuala Lumpur; Kuala Lumpur; On-site; MYR 120,000 - 180,000; Full time

Job summary

Virtuos Kuala Lumpur is seeking an experienced Senior QA Engineer to ensure the quality, reliability, and performance of AI products used internally across web, cloud, and desktop platforms. You will lead testing from early prototypes through release, collaborate with R&D, product managers, and internal users, and build automated checks while mentoring junior QA engineers.

The role emphasizes safeguarding confidential data, evaluating AI outputs, and integrating tests into CI/CD pipelines to

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, or a related field.
• 5+ years of QA experience, including at least 2 years in a senior or lead capacity.
• Strong experience testing cloud applications, APIs, and software integrations; desktop testing familiarity.
• Hands-on experience testing AI-enabled applications with LLMs; assess outputs across runs and define quality measures.
• Proficiency in Python or JavaScript/TypeScript for test automation; experience with Playwright, Cypress, Selenium, pytest/Jest.
• Experience adding automated tests to CI/CD pipelines (e.g., GitLab CI); knowledge of Git, REST API testing, authentication, and RBAC.
• Strong analytical and troubleshooting skills; ability to communicate quality risks and lead testing across teams.
• Ability to mentor QA colleagues and own quality through release and ongoing use.

Responsibilities

• Define test strategies, plans, and release criteria for internal AI products.
• Test complete user workflows across web, cloud, and desktop apps; verify APIs and access controls.
• Build and maintain evaluation datasets with clear scoring criteria for accuracy, relevance, and task success.
• Evaluate AI outputs through repeatable tests and human review; cover incorrect or unsupported answers and unusual inputs.
• Test AI knowledge search and agents for tool use, approvals, and content protection.
• Ensure safeguards for confidential data; prevent unauthorized access and data leakage.
• Create automated functional, API, regression, and AI evaluation tests; integrate into CI/CD pipelines.
• Assess performance: response times, concurrency, timeouts, and error messaging.
• Coordinate pilot and user acceptance testing with internal teams and capture issues with reproducible steps.
• Work with engineers to investigate defects; document inputs, prompts, logs, and reproduction steps.
• Report coverage and AI quality trends; advise on release readiness and post-launch issues.
• Mentor junior QA engineers and share testing methods and automation practices.

Skills

QA leadership

Analytical troubleshooting

Test strategy

Mentoring

Education

Bachelor's degree in CS/SE or related

Tools

Playwright

Cypress

Selenium

pytest

Jest

GitLab CI

Job description

Virtuos Kuala Lumpur is seeking an experienced Senior QA Engineer to ensure the quality, reliability, and performance of AI products used internally across web, cloud, and desktop platforms. You will lead testing from early prototypes through release, collaborate with R&D, product managers, and internal users, and build automated checks while mentoring junior QA engineers.

The role emphasizes safeguarding confidential data, evaluating AI outputs, and integrating tests into CI/CD pipelines to