Automation Testing

Hammerjack Pty Ltd; Philippines; On-site; PHP 5,653,000 - 9,422,000; Full time

Job summary

Hammerjack Pty Ltd is seeking an Automation Testing + AI Model Assurance Engineer to validate the quality, reliability, performance, and governance of AI-powered applications. The role focuses on test automation frameworks, API testing, AI model validation, and prompt testing for Generative AI and ML solutions.

The candidate will design automation frameworks, validate AI model behavior, test conversational AI experiences, identify model risks, and collaborate with cross-functional teams to

Qualifications

• Must have hands-on experience with test automation frameworks and API testing.
• Strong AI/ML model validation and prompt testing abilities are required.
• Experience with conversational AI testing across chatbots and LLMs is essential.

Responsibilities

• Design and implement automation frameworks for AI product validation.
• Validate AI model behavior and test conversational experiences.
• Identify model risks and ensure quality across releases.
• Collaborate with cross-functional teams to deliver high-quality AI products.

Skills

Automation Testing

API Testing

AI/ML Model Validation & Testing

Conversational AI Testing

Test Automation Framework Development

Functional & Regression Testing

Python or Java

Defect Management & Test Reporting

Prompt Testing & Response Validation

Agile/Scrum Methodology

Tools

Selenium

Playwright

Cypress

Postman

REST Assured

SoapUI

Job description

Relocation Required to Abu Dhabi.

We are seeking an experienced Automation Testing + AI Model Assurance Engineer to validate and assure the quality, reliability, performance, and governance of AI-powered applications and conversational systems. The ideal candidate should have strong expertise in test automation frameworks, API testing, AI model validation, prompt testing, and quality assurance practices across Generative AI and Machine Learning solutions.

The role involves designing automation frameworks, validating AI model behavior, testing conversational AI experiences, identifying model risks, and collaborating with cross-functional teams to ensure high-quality AI product releases.

Must-Have Skills

• Automation Testing (Selenium, Playwright, Cypress, or equivalent)
• API Testing (Postman, REST Assured, SoapUI)
• AI/ML Model Validation & Testing
• Conversational AI Testing (Chatbots, Virtual Assistants, LLMs)
• Test Automation Framework Development
• Functional & Regression Testing
• Python or Java
• Defect Management & Test Reporting
• Prompt Testing & Response Validation
• Agile/Scrum Methodology