Senior QA Engineer for Internal AI Tools

Counterpunch A Virtuos Studio; Malaysia; On-site; MYR 120,000 - 160,000; Full time

Job summary

Counterpunch A Virtuos Studio is seeking a Senior QA Engineer to ensure the quality, reliability, and performance of internal AI products used across the company. You will lead testing from early prototypes through release, collaborating with R&D engineers, product managers, and internal users.

You will build automated checks, maintain evaluation datasets, mentor junior QA engineers, and define test strategies for cloud, web, and desktop workflows, with a focus on data security and AI output

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, or related field.
• 5+ years QA experience, including at least 2 years in a senior or lead capacity.
• Strong experience testing cloud applications, APIs, and software integrations. Familiarity with desktop application testing.
• Hands-on experience testing AI-enabled applications, including products using large language models.
• Experience adding automated tests to CI/CD pipelines, such as GitLab CI. Working knowledge of Git, REST API testing, authentication, and role-based access control.

Responsibilities

• Define test strategies, plans, and release criteria for internal AI products.
• Test complete user workflows across web, cloud, and desktop applications, including APIs and access controls.
• Build and maintain evaluation datasets with clear scoring criteria for accuracy and relevance.
• Evaluate AI outputs through repeatable tests and human reviews.
• For AI knowledge search, verify source accuracy, references, and access restrictions.
• Test safeguards for confidential information and unauthorized access.
• Build automated functional, API, regression, and AI evaluation tests and integrate into CI/CD.
• Assess response times, concurrency, and error handling for AI services.
• Coordinate pilot and user acceptance testing with internal teams.
• Investigate defects with engineers and document reproduction steps.
• Report on test coverage and release risks; mentor junior QA engineers.

Skills

QA experience

Senior/lead

CI/CD

API testing

Troubleshooting

Mentoring

Education

Bachelor's degree in CS/SE

Tools

GitLab CI

Git

REST API testing

Authentication

RBAC

Job description

Counterpunch A Virtuos Studio is seeking a Senior QA Engineer to ensure the quality, reliability, and performance of internal AI products used across the company. You will lead testing from early prototypes through release, collaborating with R&D engineers, product managers, and internal users.

You will build automated checks, maintain evaluation datasets, mentor junior QA engineers, and define test strategies for cloud, web, and desktop workflows, with a focus on data security and AI output