QA Engineer – AI Maintenance & Technology Upgrades

QUESS SELECTION & SERVICES PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Quess Selection & Services, Singapore is seeking an experienced QA professional to lead testing for AI-powered applications. You will design test strategies, execute tests, and validate end-to-end processes across AI models, APIs, and integrated systems.

The role involves supporting model upgrades, validating performance against quality metrics, and participating in release readiness reviews. Strong SDLC/STLC knowledge and CI/CD familiarity are required.

Qualifications

• Bachelor's degree in Computer Science, IT, Engineering or related discipline.
• 6–9 years of experience in software quality assurance, testing, or quality engineering.
• Experience with enterprise applications, AI/ML solutions, or digital platforms preferred.
• Experience in banking/financial services or operations environments advantageous.

Responsibilities

• Design, develop, and execute test plans, test cases, and test scripts for AI-powered applications and services.
• Perform functional, integration, system, regression, and UAT testing support.
• Validate end-to-end workflows across AI applications, APIs, and integrated systems.
• Identify, document, track, and verify resolution of defects and issues.
• Support testing during AI model upgrades and conduct model output comparisons.
• Validate model performance against predefined quality metrics such as accuracy, relevance, consistency, and completeness.
• Support testing during infrastructure, platform, security, and technology upgrades.
• Participate in release readiness reviews and post-release verification.
• Ensure test evidence and documentation are maintained for audit and governance.

Skills

Analytical thinking

Problem solving

Attention to detail

Communication

Stakeholder management

Independent work

Education

Bachelor's degree in Computer Science, Information Technology, Engineering

Tools

Postman

Swagger

SQL

Python

Selenium

Playwright

CI/CD

Job description

Key Responsibilities:

Quality Assurance & Testing

• Design, develop, and execute test plans, test cases, and test scripts for AI-powered applications and services.
• Perform functional, integration, system, regression, and user acceptance testing (UAT) support.
• Validate end-to-end workflows across AI applications, APIs, and integrated systems.
• Identify, document, track, and verify resolution of defects and issues.

Model Upgrade Validation

• Support testing and validation activities during AI model upgrades.
• Conduct model output comparisons and regression testing to assess the impact of model changes.
• Validate model performance against predefined quality metrics such as accuracy, relevance, consistency, and completeness.

Technology Upgrade & Release Support

• Support testing for AI models during infrastructure, platform, security, and technology upgrades.
• Validate system stability following upgrades to application frameworks, libraries, APIs, and supporting technologies.
• Participate in release readiness reviews, production deployment validation, and post-release verification.
• Ensure appropriate test evidence and documentation are maintained for audit and governance purposes.

Operational Support

• Support production incident investigations related to model or technology changes.
• Assist with root cause analysis and validation of fixes.
• Monitor service quality trends and provide recommendations for quality improvements.
• Work closely with Group Operations and Technology teams to ensure service reliability and business continuity.

Requirements:

Education & Experience

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
• 6-9 years of experience in software quality assurance, testing, or quality engineering.
• Experience supporting enterprise applications, AI/ML solutions, or digital platforms is preferred.
• Experience in banking, financial services, or operations environments is advantageous.

Technical Skills

• Strong understanding of software testing methodologies and SDLC/STLC processes.
• Experience with API testing tools such as Postman, Swagger, or equivalent.
• Familiarity with SQL and data validation techniques.
• Knowledge of test automation frameworks and scripting languages (e.g., Python, Selenium, Playwright).
• Understanding of CI/CD pipelines and DevOps practices.
• Familiarity with AI/ML or GenAI concepts, model testing, and prompt validation.
• Exposure to monitoring, logging, and observability tools is a plus.

Functional Competencies

• Strong analytical and problem-solving skills.
• Ability to interpret test results and identify root causes of issues.
• Excellent attention to detail and commitment to quality.
• Strong communication and stakeholder management skills.
• Ability to work independently in a fast-paced and evolving environment.

Preferred Skills

• Experience testing AI, GenAI, chatbot, or machine learning solutions.
• Experience validating model performance and conducting AI regression testing.
• Knowledge of model governance, risk controls, and change management processes

Quess Selection & Services, Singapore