Lead AI QA Engineer for Agentic Workflows

Our Clients; Taguig; On-site; PHP 1,200,000 - 1,500,000; Full time

Job summary

Our Clients is seeking an Agentic AI Application Tester to oversee quality assurance and testing for AI-powered systems. This role requires a blend of technical testing proficiency and an understanding of agent-based systems throughout their lifecycle.

The ideal candidate will have a minimum of 3 years of QA experience, particularly with AI/ML systems. The position demands strong Python skills and the ability to work collaboratively across engineering teams, ensuring ongoing performance and reliability of applications.

Qualifications

• Minimum 3 years in QA or test automation, or 2 years testing AI/ML systems.
• Solid Python programming skills for test automation and data analysis.
• Strong attention to detail and collaborative work approach.

Responsibilities

• Define and execute testing and QA strategies for AI workflows.
• Continuously monitor system behavior in production environments.
• Implement monitoring systems to identify quality issues.

Skills

Python programming

AI evaluation frameworks

UI Automation with Playwright

Test automation

API validation

Tools

Prometheus

Grafana

Job description

Our Clients is seeking an Agentic AI Application Tester to oversee quality assurance and testing for AI-powered systems. This role requires a blend of technical testing proficiency and an understanding of agent-based systems throughout their lifecycle.

The ideal candidate will have a minimum of 3 years of QA experience, particularly with AI/ML systems. The position demands strong Python skills and the ability to work collaboratively across engineering teams, ensuring ongoing performance and reliability of applications.